Jul 08 18:05:25 devstack cinder-volume[76035]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:05:25 devstack cinder-volume[76035]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:05:25 devstack cinder-volume[76035]: we strongly recommend against using it for new projects. Jul 08 18:05:25 devstack cinder-volume[76035]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:05:25 devstack cinder-volume[76035]: framework. For more detail see Jul 08 18:05:25 devstack cinder-volume[76035]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:05:25 devstack cinder-volume[76035]: import eventlet # noqa Jul 08 18:05:28 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:05:28 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:05:28 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:05:29 devstack cinder-volume[76035]: INFO dbcounter [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Registered counter for database cinder Jul 08 18:05:29 devstack cinder-volume[76035]: DEBUG oslo_db.sqlalchemy.engines [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:05:29 devstack cinder-volume[76035]: DEBUG dbcounter [-] [76035] Writer thread running {{(pid=76035) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:05:29 devstack cinder-volume[76035]: INFO cinder.rpc [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:05:29 devstack cinder-volume[76035]: INFO cinder.rpc [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:05:29 devstack cinder-volume[76035]: DEBUG oslo_db.sqlalchemy.engines [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:05:29 devstack cinder-volume[76035]: INFO cinder.volume.manager [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Determined volume DB was empty at startup. Jul 08 18:05:29 devstack cinder-volume[76035]: DEBUG cinder.volume.manager [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76035) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:05:29 devstack cinder-volume[76035]: INFO cinder.volume.manager [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 18:05:29 devstack cinder-volume[76035]: WARNING stevedore.named [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:05:29 devstack cinder-volume[76035]: WARNING castellan.key_manager [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:05:29 devstack cinder-volume[76035]: WARNING cinder.keymgr.conf_key_mgr [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:05:29 devstack cinder-volume[76035]: DEBUG cinder.volume.drivers.lvm [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76035) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 18:05:29 devstack cinder-volume[76035]: DEBUG oslo_concurrency.processutils [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76035) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_concurrency.processutils [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.573s {{(pid=76035) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_db.sqlalchemy.engines [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:05:30 devstack cinder-volume[76035]: INFO cinder.rpc [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 18:05:30 devstack cinder-volume[76035]: INFO cinder.rpc [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 18:05:30 devstack cinder-volume[76035]: WARNING stevedore.named [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:05:30 devstack cinder-volume[76035]: WARNING castellan.key_manager [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:05:30 devstack cinder-volume[76035]: INFO cinder.volume.manager [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_db.sqlalchemy.engines [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76035) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:05:30 devstack cinder-volume[76035]: INFO oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Starting 1 workers Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Started child 76212 {{(pid=76035) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Full set of CONF: {{(pid=76035) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] ******************************************************************************** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Configuration options gathered from: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] ================================================================================ {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] allow_availability_zone_fallback = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] allow_compression_on_image_upload = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] allowed_direct_url_schemes = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] api_rate_limit = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] auth_strategy = keystone {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] az_cache_duration = 3600 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_availability_zone = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_host = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_stats_polling_interval = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backup_api_class = cinder.backup.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backup_name_template = backup-%s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backup_use_same_host = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backup_use_temp_snapshot = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] chap_password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] chap_username = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_internal_tenant_project_id = a08b1dd89b4c48c4946263504a9f721c {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_internal_tenant_user_id = 1e7cb44b5ae9422e80df60a7c017b08d {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cloned_volume_same_az = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cluster = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] compression_format = gzip {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76212]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] compute_api_class = cinder.compute.nova.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] config_dir = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] config_source = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] control_exchange = openstack {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] debug = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] default_availability_zone = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] default_group_type = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] default_volume_type = lvmdriver-1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] disk_geometry = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] driver_client_cert = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] driver_client_cert_key = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] driver_data_namespace = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] driver_ssl_cert_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] driver_ssl_cert_verify = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] driver_use_ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] enable_force_upload = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] enable_new_services = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] enable_unsupported_driver = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] enforce_multipath_for_image_xfer = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] filter_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_api_insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_api_ssl_compression = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_ca_certificates_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_catalog_info = image:glance:publicURL {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_num_retries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance_request_timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] goodness_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] graceful_shutdown_timeout = 5 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] group_api_class = cinder.group.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] host = devstack {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack sudo[76217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_compress_on_upload = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_conversion_address_space_limit = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_conversion_cpu_limit = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_conversion_disable = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_upload_use_cinder_backend = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_upload_use_internal_tenant = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack sudo[76217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_volume_cache_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_volume_cache_max_count = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] image_volume_cache_max_size_gb = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] init_host_max_objects_retrieval = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] instance_format = [instance: %(uuid)s] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:30 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] iscsi_target_flags = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] iscsi_write_cache = on {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] iser_helper = tgtadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] iser_ip_address = 192.168.122.74 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] iser_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_color = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_config_append = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_dir = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_options = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_rotate_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_rotate_interval_type = days {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] log_rotation_type = none {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] max_age = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] max_logfile_count = 30 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] max_logfile_size_mb = 200 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] max_over_subscription_ratio = 20.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] message_reap_interval = 86400 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] message_ttl = 2592000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] migration_create_volume_timeout_secs = 300 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] monkey_patch = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] monkey_patch_modules = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] my_ip = 192.168.122.74 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] no_snapshot_gb_quota = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] num_iser_scan_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] num_shell_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] num_volume_device_scan_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] nvmeof_conn_info_version = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] nvmet_ns_id = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] nvmet_port_id = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] osapi_max_limit = 1000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] osapi_volume_ext_list = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] osapi_volume_listen_port = 8776 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] osapi_volume_use_ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] osapi_volume_workers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] per_volume_size_limit = -1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] periodic_fuzzy_delay = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] periodic_interval = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] public_endpoint = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] publish_errors = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] quota_backup_gigabytes = 1000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] quota_backups = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] quota_gigabytes = 1000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] quota_groups = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] quota_snapshots = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] quota_volumes = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] rate_limit_burst = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] rate_limit_except_level = CRITICAL {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] rate_limit_interval = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] reinit_driver_count = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] replication_device = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] report_discard_supported = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] report_interval = 120 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] reservation_clean_interval = 86400 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] reservation_expire = 86400 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] reserved_image_namespaces = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] reserved_percentage = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] rpc_response_timeout = 120 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] run_external_periodic_tasks = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] scst_target_driver = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] scst_target_iqn_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_down_time = 720 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] shell_completion = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] snapshot_name_template = snapshot-%s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] snapshot_same_host = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] state_path = /opt/stack/data/cinder {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] storage_availability_zone = nova {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] storage_protocol = iSCSI {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] syslog_log_facility = LOG_USER {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] target_helper = lioadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] target_ip_address = 192.168.122.74 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] target_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] target_protocol = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] target_secondary_ip_addresses = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] trace_flags = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] transport_url = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] until_refresh = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] use_chap_auth = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] use_default_quota_class = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] use_journal = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] use_json = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] use_multipath_for_image_xfer = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] use_stderr = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] use_syslog = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] verify_glance_signatures = enabled {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_api_class = cinder.volume.api.API {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_backend_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_clear = zero {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_clear_ionice = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_clear_size = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_copy_bps_limit = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_dd_blocksize = 1M {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_name_template = volume-%s {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_service_inithost_offload = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volume_usage_audit_period = month {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] zoning_mode = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_concurrency.disable_process_locking = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.auth_section = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.auth_type = password {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.auth_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.cache = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76212]: INFO cinder.volume.manager [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.include_service_catalog = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.interface = public {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_password = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcache_username = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.region_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.service_type = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.backend = dogpile.cache.null {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.backend_argument = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.backend_expiration_time = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.config_prefix = cache.oslo {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.debug_cache_backend = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.enable_retry_client = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.enable_socket_keepalive = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.expiration_time = 600 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.hashclient_retry_attempts = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.memcache_dead_retry = 300 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.memcache_pool_maxsize = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.memcache_sasl_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.proxies = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.redis_db = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.redis_server = localhost:6379 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.retry_attempts = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.retry_delay = 0.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.socket_keepalive_count = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.socket_keepalive_idle = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.socket_keepalive_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.socket_timeout = 1.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.tls_allowed_ciphers = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.tls_cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.tls_certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.tls_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.tls_keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cache.username = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] coordination.backend_url = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.asyncio_connection = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.asyncio_slave_connection = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.backend = sqlalchemy {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.connection = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.connection_debug = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.connection_parameters = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.connection_recycle_time = 3600 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.connection_trace = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.db_inc_retry_interval = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.db_max_retries = 20 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.db_max_retry_interval = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.db_retry_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.max_overflow = 50 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.max_pool_size = 5 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.max_retries = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.mysql_wsrep_sync_wait = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.pool_timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.retry_interval = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.slave_connection = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.sqlite_synchronous = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.synchronous_reader = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] database.use_db_reconnect = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.connection_string = messaging:// {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.es_doc_type = notification {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.es_scroll_size = 10000 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.es_scroll_time = 2m {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.filter_error_trace = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.hmac_keys = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.sentinel_service_name = mymaster {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.socket_timeout = 0.1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.trace_requests = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler.trace_sqlalchemy = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler_jaeger.process_tags = {} {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler_jaeger.service_name_prefix = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] profiler_otlp.service_name_prefix = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.enforce_new_defaults = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.enforce_scope = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.policy_default_rule = default {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.policy_file = policy.yaml {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] privsep_osbrick.group = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] privsep_osbrick.helper_command = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] privsep_osbrick.user = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_sys_admin.group = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_sys_admin.helper_command = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] cinder_sys_admin.user = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.auth_section = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.auth_type = password {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.collect_timing = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.send_service_user_token = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] service_user.timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.auth_section = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.auth_type = password {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.collect_timing = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.region_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] glance.timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.backend_availability_zone = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.chap_password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.chap_username = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.disk_geometry = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.driver_client_cert = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.driver_client_cert_key = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.driver_data_namespace = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.driver_use_ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.extra_capabilities = {} {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.filter_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.goodness_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.iscsi_target_flags = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.iscsi_write_cache = on {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.iser_helper = tgtadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.iser_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.lvm_share_target = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.lvm_type = auto {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.num_shell_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.replication_device = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.report_discard_supported = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.reserved_percentage = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.target_helper = tgtadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.target_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.target_protocol = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.trace_flags = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.unique_fqdn_network = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.use_chap_auth = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_backend_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_clear = zero {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_clear_ionice = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_clear_size = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_reports.file_event_handler = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_reports.log_dir = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.backend_host = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.chap_password = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.chap_username = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.disk_geometry = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.driver_client_cert = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.extra_capabilities = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.filter_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.goodness_function = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.iser_helper = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.iser_ip_address = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.iser_port = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.lvm_share_target = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.lvm_type = auto {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.num_shell_tries = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.replication_device = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.report_discard_supported = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.reserved_percentage = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.scst_target_driver = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.storage_protocol = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.target_helper = lioadm {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.target_ip_address = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.target_port = 3260 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.trace_flags = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.use_chap_auth = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_clear = zero {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_clear_size = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] lvmdriver-1.volumes_dir = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_notifications.driver = [] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_notifications.retry = -1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] key_manager.fixed_key = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.barbican_api_version = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.barbican_endpoint = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.barbican_endpoint_type = public {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.barbican_region_name = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.collect_timing = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.number_of_retries = 60 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.retry_delay = 1 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.send_service_user_token = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.verify_ssl = True {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican.verify_ssl_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.auth_section = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.auth_type = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.cafile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.certfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.collect_timing = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.insecure = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.keyfile = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.split_loggers = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] barbican_service_user.timeout = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.approle_role_id = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.approle_secret_id = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.kv_mountpoint = secret {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.kv_path = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.kv_version = 2 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.namespace = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.root_token_id = **** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.ssl_ca_crt_file = None {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.timeout = 60.0 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.use_ssl = False {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:05:31 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] ******************************************************************************** {{(pid=76035) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:05:31 devstack sudo[76217]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.772s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:31 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:31 devstack sudo[76253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:31 devstack sudo[76253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:32 devstack sudo[76253]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:32 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.692s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:32 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:05:32 devstack cinder-volume[76212]: INFO cinder.brick.local_dev.lvm [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 18:05:32 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:32 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:32 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:32 devstack sudo[76525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:05:32 devstack sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:33 devstack sudo[76525]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:33 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:33 devstack cinder-volume[76212]: DEBUG cinder.brick.local_dev.lvm [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76212) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 18:05:33 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:33 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:33 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:34 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:34 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.249s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:34 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:34 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:34 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:34 devstack sudo[76958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:34 devstack sudo[76958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:35 devstack sudo[76958]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:35 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.693s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:35 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:35 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:35 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:35 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 18:05:35 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:35 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:35 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.663s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:35 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:35 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:05:35 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:36 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:36 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.834s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:36 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:36 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:05:36 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:37 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:37 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:37 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:37 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:05:37 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:38 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:38 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.825s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:38 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:38 devstack sudo[77023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:38 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:38 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:38 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.774s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:38 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:38 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:38 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:39 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:39 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:39 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:39 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:39 devstack cinder-volume[76212]: INFO cinder.volume.drivers.lvm [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 18:05:39 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:39 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:39 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:39 devstack sudo[77040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:39 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:40 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:40 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.730s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:40 devstack cinder-volume[76212]: DEBUG cinder.volume.drivers.lvm [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Updating volume stats {{(pid=76212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:05:40 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:40 devstack sudo[77158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:05:40 devstack sudo[77158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:40 devstack cinder-volume[76035]: DEBUG dbcounter [-] [76035] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76035) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:05:41 devstack sudo[77158]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:41 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:41 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:41 devstack sudo[77214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:05:41 devstack sudo[77214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:41 devstack sudo[77214]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:41 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:41 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:41 devstack sudo[77302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:41 devstack sudo[77302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:42 devstack sudo[77302]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:42 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:42 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:42 devstack sudo[77305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:05:42 devstack sudo[77305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:42 devstack sudo[77305]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:42 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:42 devstack cinder-volume[76212]: INFO cinder.volume.driver [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:05:42 devstack cinder-volume[76212]: DEBUG cinder.volume.driver [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76212) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:05:43 devstack cinder-volume[76212]: DEBUG oslo_db.sqlalchemy.engines [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:05:43 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writer thread running {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:05:43 devstack cinder-volume[76212]: DEBUG cinder.db.api [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Building query based on filter {{(pid=76212) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:05:43 devstack cinder-volume[76212]: DEBUG cinder.image.image_utils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76212) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:05:43 devstack cinder-volume[76212]: INFO cinder.keymgr.migration [None req-7b6b4bc3-3580-4140-961a-b3666a7eac30 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:05:43 devstack cinder-volume[76212]: DEBUG cinder.volume.drivers.lvm [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Updating volume stats {{(pid=76212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:05:43 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:43 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:05:43 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:43 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:43 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:43 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:43 devstack sudo[77317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:05:43 devstack sudo[77317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:44 devstack sudo[77317]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:44 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:44 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:44 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:44 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:45 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:45 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:45 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:45 devstack sudo[77324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:05:45 devstack sudo[77324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:45 devstack sudo[77324]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:45 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:45 devstack cinder-volume[76212]: DEBUG cinder.manager [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Notifying Schedulers of capabilities ... {{(pid=76212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:05:45 devstack cinder-volume[76212]: INFO cinder.volume.manager [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Driver initialization completed successfully. Jul 08 18:05:45 devstack cinder-volume[76212]: INFO cinder.manager [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Initiating service 2 cleanup Jul 08 18:05:45 devstack cinder-volume[76212]: INFO cinder.manager [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Service 2 cleanup completed. Jul 08 18:05:45 devstack cinder-volume[76212]: DEBUG cinder.service [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Creating RPC server for service cinder-volume {{(pid=76212) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:05:45 devstack cinder-volume[76212]: DEBUG cinder.service [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76212) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:05:45 devstack cinder-volume[76212]: INFO cinder.volume.manager [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 18:05:45 devstack cinder-volume[76212]: DEBUG cinder.volume.drivers.lvm [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Updating volume stats {{(pid=76212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:05:45 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:46 devstack sudo[77328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:05:46 devstack sudo[77328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:46 devstack sudo[77328]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:46 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:46 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:46 devstack sudo[77332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:05:46 devstack sudo[77332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:47 devstack sudo[77332]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:47 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:47 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:47 devstack sudo[77338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:05:47 devstack sudo[77338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:48 devstack sudo[77338]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:48 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:48 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:05:48 devstack sudo[77395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:05:48 devstack sudo[77395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:05:48 devstack sudo[77395]: pam_unix(sudo:session): session closed for user root Jul 08 18:05:48 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:05:48 devstack cinder-volume[76212]: INFO cinder.volume.manager [None req-ac82a0bb-e1e7-4005-a68b-dfb330480af1 None None] Driver post RPC initialization completed successfully. Jul 08 18:05:52 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager._thread_info {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:05:52 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread count: 6 {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:05:52 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread info: [<_MainThread(MainThread, started 124442442723456)>, , , , , ] {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:05:58 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:05:58 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:06:52 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:06:52 devstack cinder-volume[76212]: DEBUG cinder.volume.drivers.lvm [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Updating volume stats {{(pid=76212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:06:52 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:06:52 devstack sudo[79183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:06:52 devstack sudo[79183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:06:53 devstack sudo[79183]: pam_unix(sudo:session): session closed for user root Jul 08 18:06:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:06:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:06:53 devstack sudo[79186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:06:53 devstack sudo[79186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:06:53 devstack sudo[79186]: pam_unix(sudo:session): session closed for user root Jul 08 18:06:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:06:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:06:53 devstack sudo[79189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:06:53 devstack sudo[79189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:06:54 devstack sudo[79189]: pam_unix(sudo:session): session closed for user root Jul 08 18:06:54 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:06:54 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:06:54 devstack sudo[79193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:06:54 devstack sudo[79193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:06:55 devstack sudo[79193]: pam_unix(sudo:session): session closed for user root Jul 08 18:06:55 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:06:55 devstack cinder-volume[76212]: DEBUG cinder.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Notifying Schedulers of capabilities ... {{(pid=76212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:06:55 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager._thread_info {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:06:55 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread count: 6 {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:06:55 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread info: [<_MainThread(MainThread, started 124442442723456)>, , , , , ] {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:07:52 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:07:52 devstack cinder-volume[76212]: DEBUG cinder.volume.drivers.lvm [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Updating volume stats {{(pid=76212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:07:52 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:07:52 devstack sudo[82536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:07:52 devstack sudo[82536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:07:53 devstack sudo[82536]: pam_unix(sudo:session): session closed for user root Jul 08 18:07:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:07:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:07:53 devstack sudo[82554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:07:53 devstack sudo[82554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:07:53 devstack sudo[82554]: pam_unix(sudo:session): session closed for user root Jul 08 18:07:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:07:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:07:54 devstack sudo[82557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:07:54 devstack sudo[82557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:07:54 devstack sudo[82557]: pam_unix(sudo:session): session closed for user root Jul 08 18:07:54 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:07:54 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:07:54 devstack sudo[82566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:07:54 devstack sudo[82566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:07:55 devstack sudo[82566]: pam_unix(sudo:session): session closed for user root Jul 08 18:07:55 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:07:55 devstack cinder-volume[76212]: DEBUG cinder.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Notifying Schedulers of capabilities ... {{(pid=76212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:07:55 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager._thread_info {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:07:55 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread count: 6 {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:07:55 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread info: [<_MainThread(MainThread, started 124442442723456)>, , , , , ] {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:07:58 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writing DB stats cinder:SELECT=1 {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:07:58 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writing DB stats cinder:UPDATE=1 {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:08:52 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:08:52 devstack cinder-volume[76212]: DEBUG cinder.volume.drivers.lvm [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Updating volume stats {{(pid=76212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:08:52 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:08:52 devstack sudo[84541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:08:52 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:08:53 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root Jul 08 18:08:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:08:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:08:53 devstack sudo[84550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:08:53 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:08:53 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root Jul 08 18:08:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:08:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:08:53 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:08:53 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:08:54 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Jul 08 18:08:54 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:08:54 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:08:54 devstack sudo[84578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:08:54 devstack sudo[84578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:08:55 devstack sudo[84578]: pam_unix(sudo:session): session closed for user root Jul 08 18:08:55 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:08:55 devstack cinder-volume[76212]: DEBUG cinder.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Notifying Schedulers of capabilities ... {{(pid=76212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:08:55 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager._thread_info {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:08:55 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread count: 6 {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:08:55 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread info: [<_MainThread(MainThread, started 124442442723456)>, , , , , ] {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:09:52 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:09:52 devstack cinder-volume[76212]: DEBUG cinder.volume.drivers.lvm [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Updating volume stats {{(pid=76212) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 18:09:52 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:09:52 devstack sudo[85787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 18:09:52 devstack sudo[85787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:09:53 devstack sudo[85787]: pam_unix(sudo:session): session closed for user root Jul 08 18:09:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:09:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:09:53 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:09:53 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:09:53 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Jul 08 18:09:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:09:53 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:09:54 devstack sudo[85807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 18:09:54 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:09:54 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root Jul 08 18:09:54 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:09:54 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:09:54 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 18:09:54 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:09:55 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Jul 08 18:09:55 devstack cinder-volume[76212]: DEBUG oslo_concurrency.processutils [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=76212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:09:55 devstack cinder-volume[76212]: DEBUG cinder.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Notifying Schedulers of capabilities ... {{(pid=76212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:09:55 devstack cinder-volume[76212]: DEBUG oslo_service.periodic_task [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] Running periodic task VolumeManager._thread_info {{(pid=76212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:09:55 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread count: 6 {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:09:55 devstack cinder-volume[76212]: DEBUG cinder.volume.manager [None req-74acf08f-8828-48cb-a638-41d8e9c89edf None None] thread info: [<_MainThread(MainThread, started 124442442723456)>, , , , , ] {{(pid=76212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:09:58 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writing DB stats cinder:SELECT=1 {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:09:58 devstack cinder-volume[76212]: DEBUG dbcounter [-] [76212] Writing DB stats cinder:UPDATE=1 {{(pid=76212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:10:15 devstack cinder-volume[76035]: INFO oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Caught SIGTERM, stopping children Jul 08 18:10:15 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Acquiring lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:10:15 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Acquired lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:10:15 devstack cinder-volume[76035]: DEBUG oslo_concurrency.lockutils [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Releasing lock "singleton_lock" {{(pid=76035) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:10:15 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Stop services. {{(pid=76035) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 18:10:15 devstack cinder-volume[76035]: DEBUG oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Killing children. {{(pid=76035) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 18:10:15 devstack cinder-volume[76035]: INFO oslo_service.backend._eventlet.service [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Waiting on 1 children to exit Jul 08 18:10:20 devstack cinder-volume[76212]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 08 18:10:20 devstack cinder-volume[86380]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:10:20 devstack cinder-volume[86380]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:10:20 devstack cinder-volume[86380]: we strongly recommend against using it for new projects. Jul 08 18:10:20 devstack cinder-volume[86380]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:10:20 devstack cinder-volume[86380]: framework. For more detail see Jul 08 18:10:20 devstack cinder-volume[86380]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:10:20 devstack cinder-volume[86380]: import eventlet # noqa Jul 08 18:10:20 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Acquiring lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:10:20 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Acquired lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:10:20 devstack cinder-volume[76212]: DEBUG oslo_concurrency.lockutils [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Releasing lock "singleton_lock" {{(pid=76212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:10:20 devstack cinder-volume[76212]: WARNING amqp [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:10:21 devstack cinder-volume[76212]: WARNING amqp [None req-fd7a8120-5df2-4462-9843-708f2d036aa9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:10:22 devstack cinder-volume[86380]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:10:22 devstack cinder-volume[86380]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:10:22 devstack cinder-volume[86380]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:10:23 devstack cinder-volume[86380]: INFO dbcounter [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Registered counter for database cinder Jul 08 18:10:23 devstack cinder-volume[86380]: DEBUG oslo_db.sqlalchemy.engines [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG dbcounter [-] [86380] Writer thread running {{(pid=86380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:10:24 devstack cinder-volume[86380]: INFO cinder.rpc [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:10:24 devstack cinder-volume[86380]: INFO cinder.rpc [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_db.sqlalchemy.engines [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:10:24 devstack cinder-volume[86380]: INFO cinder.volume.manager [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Determined volume DB was empty at startup. Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG cinder.volume.manager [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86380) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:10:24 devstack cinder-volume[86380]: INFO cinder.volume.manager [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 18:10:24 devstack cinder-volume[86380]: WARNING stevedore.named [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:10:24 devstack cinder-volume[86380]: WARNING castellan.key_manager [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:10:24 devstack cinder-volume[86380]: WARNING cinder.keymgr.conf_key_mgr [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:10:24 devstack cinder-volume[86380]: INFO cinder.volume.manager [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_db.sqlalchemy.engines [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:10:24 devstack cinder-volume[86380]: INFO oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Starting 1 workers Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Started child 86651 {{(pid=86380) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Full set of CONF: {{(pid=86380) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] ******************************************************************************** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Configuration options gathered from: {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] ================================================================================ {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] allow_availability_zone_fallback = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] allow_compression_on_image_upload = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] allowed_direct_url_schemes = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] api_rate_limit = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86651]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] auth_strategy = keystone {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_availability_zone = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_host = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_stats_polling_interval = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backup_api_class = cinder.backup.api.API {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backup_name_template = backup-%s {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backup_use_same_host = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backup_use_temp_snapshot = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] chap_password = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] chap_username = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_internal_tenant_project_id = a08b1dd89b4c48c4946263504a9f721c {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_internal_tenant_user_id = 1e7cb44b5ae9422e80df60a7c017b08d {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cluster = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] compression_format = gzip {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] compute_api_class = cinder.compute.nova.API {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] config_dir = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] config_source = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] control_exchange = openstack {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] debug = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] default_availability_zone = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] default_group_type = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] default_volume_type = QuobyteHD {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] disk_geometry = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] driver_client_cert = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] driver_client_cert_key = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] driver_data_namespace = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] driver_ssl_cert_path = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] driver_ssl_cert_verify = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] driver_use_ssl = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] enable_new_services = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] enable_unsupported_driver = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] enabled_backends = ['QuobyteHD'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] enforce_multipath_for_image_xfer = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] filter_function = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_api_insecure = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_api_ssl_compression = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_ca_certificates_file = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_catalog_info = image:glance:publicURL {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_certfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_keyfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_num_retries = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance_request_timeout = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] goodness_function = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] graceful_shutdown_timeout = 5 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] group_api_class = cinder.group.api.API {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] host = devstack {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_compress_on_upload = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_conversion_address_space_limit = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_conversion_cpu_limit = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_conversion_disable = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_upload_use_cinder_backend = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_upload_use_internal_tenant = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_volume_cache_enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_volume_cache_max_count = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] image_volume_cache_max_size_gb = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] init_host_max_objects_retrieval = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] instance_format = [instance: %(uuid)s] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] iscsi_target_flags = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] iscsi_write_cache = on {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] iser_helper = tgtadm {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] iser_ip_address = 192.168.122.74 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] iser_port = 3260 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_color = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_config_append = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_dir = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_file = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_options = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_rotate_interval = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_rotate_interval_type = days {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] log_rotation_type = none {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86651]: INFO cinder.volume.manager [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 18:10:24 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.remotefs [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86651) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] max_age = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] max_logfile_count = 30 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] max_logfile_size_mb = 200 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] max_over_subscription_ratio = 20.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] message_reap_interval = 86400 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] message_ttl = 2592000 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] migration_create_volume_timeout_secs = 300 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] monkey_patch = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] monkey_patch_modules = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] my_ip = 192.168.122.74 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] no_snapshot_gb_quota = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] num_iser_scan_tries = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] num_shell_tries = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] num_volume_device_scan_tries = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] nvmeof_conn_info_version = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] nvmet_ns_id = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] nvmet_port_id = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] osapi_max_limit = 1000 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] osapi_volume_ext_list = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] osapi_volume_listen_port = 8776 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] osapi_volume_use_ssl = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] osapi_volume_workers = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] per_volume_size_limit = -1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] periodic_fuzzy_delay = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] periodic_interval = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] public_endpoint = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] publish_errors = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] quota_backup_gigabytes = 1000 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] quota_backups = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] quota_gigabytes = 1000 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] quota_groups = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] quota_snapshots = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] quota_volumes = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] rate_limit_burst = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] rate_limit_except_level = CRITICAL {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] rate_limit_interval = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] reinit_driver_count = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] replication_device = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] report_discard_supported = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] report_interval = 120 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] reservation_clean_interval = 86400 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] reservation_expire = 86400 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] reserved_image_namespaces = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] reserved_percentage = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] rpc_response_timeout = 120 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] run_external_periodic_tasks = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] scst_target_driver = iscsi {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] scst_target_iqn_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_down_time = 720 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] shell_completion = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] snapshot_name_template = snapshot-%s {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] split_loggers = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] state_path = /opt/stack/data/cinder {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] storage_availability_zone = nova {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] storage_protocol = iSCSI {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] syslog_log_facility = LOG_USER {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] target_helper = lioadm {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] target_ip_address = 192.168.122.74 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] target_port = 3260 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] target_protocol = iscsi {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] target_secondary_ip_addresses = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] trace_flags = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] transport_url = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] until_refresh = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] use_chap_auth = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] use_default_quota_class = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] use_journal = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] use_json = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] use_multipath_for_image_xfer = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] use_stderr = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] use_syslog = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] verify_glance_signatures = enabled {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_api_class = cinder.volume.api.API {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_backend_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_clear = zero {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_clear_ionice = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_clear_size = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_copy_bps_limit = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_dd_blocksize = 1M {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_name_template = volume-%s {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_service_inithost_offload = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volume_usage_audit_period = month {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] zoning_mode = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_concurrency.disable_process_locking = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.auth_section = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.auth_type = password {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.auth_version = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.cache = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.certfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.include_service_catalog = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.insecure = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.interface = public {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.keyfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_password = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcache_username = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.region_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.service_type = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.backend = dogpile.cache.null {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.backend_argument = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.backend_expiration_time = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.config_prefix = cache.oslo {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.debug_cache_backend = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.enable_retry_client = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.enable_socket_keepalive = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.expiration_time = 600 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.hashclient_retry_attempts = 2 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.memcache_dead_retry = 300 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86651) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 18:10:24 devstack cinder-volume[86651]: WARNING cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 18:10:24 devstack cinder-volume[86651]: WARNING cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 18:10:24 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.memcache_pool_maxsize = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.memcache_sasl_enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.password = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.proxies = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.redis_db = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.redis_server = localhost:6379 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.retry_attempts = 2 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.retry_delay = 0.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.socket_keepalive_count = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.socket_keepalive_idle = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.socket_keepalive_interval = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.socket_timeout = 1.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.tls_allowed_ciphers = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.tls_cafile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.tls_certfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.tls_enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.tls_keyfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cache.username = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] coordination.backend_url = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.asyncio_connection = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.asyncio_slave_connection = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.backend = sqlalchemy {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.connection = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.connection_debug = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.connection_parameters = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.connection_recycle_time = 3600 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.connection_trace = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.db_inc_retry_interval = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.db_max_retries = 20 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.db_max_retry_interval = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.db_retry_interval = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.max_overflow = 50 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.max_pool_size = 5 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.max_retries = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.mysql_wsrep_sync_wait = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.pool_timeout = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.retry_interval = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.slave_connection = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.sqlite_synchronous = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.synchronous_reader = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] database.use_db_reconnect = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.connection_string = messaging:// {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.es_doc_type = notification {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.es_scroll_size = 10000 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.es_scroll_time = 2m {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.filter_error_trace = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.hmac_keys = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.sentinel_service_name = mymaster {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.socket_timeout = 0.1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.trace_requests = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler.trace_sqlalchemy = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler_jaeger.process_tags = {} {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler_jaeger.service_name_prefix = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] profiler_otlp.service_name_prefix = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.enforce_new_defaults = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.enforce_scope = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.policy_default_rule = default {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.policy_file = policy.yaml {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] privsep_osbrick.group = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] privsep_osbrick.helper_command = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] privsep_osbrick.user = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_sys_admin.group = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_sys_admin.helper_command = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] cinder_sys_admin.user = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.auth_section = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.auth_type = password {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.cafile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.certfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.collect_timing = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.insecure = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.keyfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.send_service_user_token = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.split_loggers = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] service_user.timeout = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.auth_section = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.auth_type = password {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.certfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.collect_timing = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.insecure = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.keyfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.region_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.split_loggers = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] glance.timeout = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.backend_availability_zone = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.chap_password = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.chap_username = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.disk_geometry = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.driver_client_cert = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.driver_client_cert_key = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.driver_data_namespace = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.driver_use_ssl = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.extra_capabilities = {} {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.filter_function = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.goodness_function = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.iscsi_target_flags = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.iscsi_write_cache = on {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.iser_helper = tgtadm {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.iser_port = 3260 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack quobyte-client[86654]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 18:10:24 devstack quobyte-client[86654]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_host = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_login = admin {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_mount_options = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_password = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_private_key = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_share_path = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=86651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.num_shell_tries = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86651]: INFO cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 ... Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa -c /etc/quobyte/client-cinder.cfg {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.quobyte_volume_url = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.replication_device = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.report_discard_supported = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.reserved_percentage = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.target_helper = tgtadm {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.target_port = 3260 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.target_protocol = iscsi {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.trace_flags = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.unique_fqdn_network = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.use_chap_auth = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volume_backend_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volume_clear = zero {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volume_clear_ionice = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volume_clear_size = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_reports.file_event_handler = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_reports.log_dir = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.backend_availability_zone = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.backend_host = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.chap_password = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.chap_username = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.chiscsi_conf = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.disk_geometry = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.driver_client_cert = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.driver_data_namespace = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.driver_use_ssl = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.extra_capabilities = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.filter_function = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.goodness_function = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.iser_helper = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.iser_ip_address = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.iser_port = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.iser_target_prefix = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_host = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_login = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_mount_options = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa -c /etc/quobyte/client-cinder.cfg Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_password = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_private_key = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_share_path = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_ssh_port = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.num_shell_tries = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.nvmet_port_id = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.replication_device = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.report_discard_supported = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.reserved_percentage = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.scst_target_driver = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.storage_protocol = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.target_helper = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.target_ip_address = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.target_port = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.target_prefix = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.target_protocol = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.trace_flags = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.use_chap_auth = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volume_clear = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volume_clear_size = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] QuobyteHD.volumes_dir = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.ssl = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_notifications.driver = [] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_notifications.retry = -1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] key_manager.fixed_key = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.barbican_api_version = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.barbican_endpoint = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.barbican_endpoint_type = public {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.barbican_region_name = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.cafile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.certfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.collect_timing = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.insecure = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.keyfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.number_of_retries = 60 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.retry_delay = 1 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.send_service_user_token = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.split_loggers = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.timeout = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.verify_ssl = True {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican.verify_ssl_path = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.auth_section = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.auth_type = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.cafile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.certfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.collect_timing = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.insecure = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.keyfile = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.split_loggers = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] barbican_service_user.timeout = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.approle_role_id = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.approle_secret_id = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.kv_mountpoint = secret {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.kv_path = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.kv_version = 2 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.namespace = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.root_token_id = **** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.ssl_ca_crt_file = None {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.timeout = 60.0 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.use_ssl = False {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:24 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] ******************************************************************************** {{(pid=86380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:10:25 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Jul 08 18:10:25 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.870s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:25 devstack cinder-volume[86651]: INFO cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 succeeded Jul 08 18:10:25 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=86651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:10:25 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.886s {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:10:25 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:25 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:10:25 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:10:26 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.688s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:26 devstack cinder-volume[86651]: INFO cinder.volume.driver [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG cinder.volume.driver [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86651) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG oslo_db.sqlalchemy.engines [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86651) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG dbcounter [-] [86651] Writer thread running {{(pid=86651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG cinder.db.api [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Building query based on filter {{(pid=86651) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG cinder.image.image_utils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86651) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:10:26 devstack cinder-volume[86651]: INFO cinder.keymgr.migration [None req-d75f419a-812b-4cc9-a5b7-bdbd5c5939ef None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=86651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=86651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:10:26 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:26 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:10:26 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:10:27 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.672s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG cinder.manager [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Notifying Schedulers of capabilities ... {{(pid=86651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:10:27 devstack cinder-volume[86651]: INFO cinder.volume.manager [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Driver initialization completed successfully. Jul 08 18:10:27 devstack cinder-volume[86651]: INFO cinder.manager [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Initiating service 3 cleanup Jul 08 18:10:27 devstack cinder-volume[86651]: INFO cinder.manager [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Service 3 cleanup completed. Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG cinder.service [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Creating RPC server for service cinder-volume {{(pid=86651) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG cinder.service [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86651) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:10:27 devstack cinder-volume[86651]: INFO cinder.volume.manager [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=86651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=86651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:10:27 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:27 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:10:27 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:10:28 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Jul 08 18:10:28 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.821s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:28 devstack cinder-volume[86651]: INFO cinder.volume.manager [None req-10cbf162-96e1-48ae-8eb3-4211dfeaf4e0 None None] Driver post RPC initialization completed successfully. Jul 08 18:10:32 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-793bd0f8-c344-4536-a209-d7ae30e3db31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:10:32 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-793bd0f8-c344-4536-a209-d7ae30e3db31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:10:32 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-793bd0f8-c344-4536-a209-d7ae30e3db31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=86651) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:10:32 devstack cinder-volume[86651]: DEBUG cinder.volume.drivers.quobyte [None req-793bd0f8-c344-4536-a209-d7ae30e3db31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=86651) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:10:32 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-793bd0f8-c344-4536-a209-d7ae30e3db31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86651) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:10:32 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-793bd0f8-c344-4536-a209-d7ae30e3db31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:32 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:10:32 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:10:32 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Jul 08 18:10:32 devstack cinder-volume[86651]: DEBUG oslo_concurrency.processutils [None req-793bd0f8-c344-4536-a209-d7ae30e3db31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.630s {{(pid=86651) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:32 devstack cinder-volume[86651]: DEBUG cinder.manager [None req-793bd0f8-c344-4536-a209-d7ae30e3db31 None None] Notifying Schedulers of capabilities ... {{(pid=86651) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:10:33 devstack cinder-volume[86651]: DEBUG oslo_service.periodic_task [None req-3aee76f8-30e2-4591-9055-f123373ce62c None None] Running periodic task VolumeManager._thread_info {{(pid=86651) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:10:33 devstack cinder-volume[86651]: DEBUG cinder.volume.manager [None req-3aee76f8-30e2-4591-9055-f123373ce62c None None] thread count: 6 {{(pid=86651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:10:33 devstack cinder-volume[86651]: DEBUG cinder.volume.manager [None req-3aee76f8-30e2-4591-9055-f123373ce62c None None] thread info: [<_MainThread(MainThread, started 134128969281664)>, , , , , ] {{(pid=86651) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:10:34 devstack cinder-volume[86380]: DEBUG dbcounter [-] [86380] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:10:34 devstack cinder-volume[86380]: INFO oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Caught SIGTERM, stopping children Jul 08 18:10:34 devstack cinder-volume[86380]: DEBUG oslo_concurrency.lockutils [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Acquiring lock "singleton_lock" {{(pid=86380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:10:34 devstack cinder-volume[86380]: DEBUG oslo_concurrency.lockutils [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Acquired lock "singleton_lock" {{(pid=86380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:10:34 devstack cinder-volume[86380]: DEBUG oslo_concurrency.lockutils [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Releasing lock "singleton_lock" {{(pid=86380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:10:34 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Stop services. {{(pid=86380) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 18:10:34 devstack cinder-volume[86380]: DEBUG oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Killing children. {{(pid=86380) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 18:10:34 devstack cinder-volume[86380]: INFO oslo_service.backend._eventlet.service [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Waiting on 1 children to exit Jul 08 18:10:38 devstack cinder-volume[86651]: DEBUG dbcounter [-] [86651] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:10:38 devstack cinder-volume[86651]: DEBUG dbcounter [-] [86651] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86651) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:10:39 devstack cinder-volume[86651]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 08 18:10:40 devstack cinder-volume[87069]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 18:10:40 devstack cinder-volume[87069]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:10:40 devstack cinder-volume[87069]: we strongly recommend against using it for new projects. Jul 08 18:10:40 devstack cinder-volume[87069]: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:10:40 devstack cinder-volume[87069]: framework. For more detail see Jul 08 18:10:40 devstack cinder-volume[87069]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:10:40 devstack cinder-volume[87069]: import eventlet # noqa Jul 08 18:10:40 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Acquiring lock "singleton_lock" {{(pid=86651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:10:40 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Acquired lock "singleton_lock" {{(pid=86651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:10:40 devstack cinder-volume[86651]: DEBUG oslo_concurrency.lockutils [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Releasing lock "singleton_lock" {{(pid=86651) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:10:40 devstack cinder-volume[86651]: WARNING amqp [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:10:40 devstack cinder-volume[86651]: WARNING amqp [None req-cc64d18e-01a7-46a8-8869-79a30941bf4a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 18:10:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87069) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 18:10:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87069) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 18:10:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87069) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 18:10:43 devstack cinder-volume[87069]: INFO dbcounter [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Registered counter for database cinder Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_db.sqlalchemy.engines [None req-00f488c6-26e0-44cb-b979-71292201008b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87069) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writer thread running {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:10:43 devstack cinder-volume[87069]: INFO cinder.rpc [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 18:10:43 devstack cinder-volume[87069]: INFO cinder.rpc [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_db.sqlalchemy.engines [None req-00f488c6-26e0-44cb-b979-71292201008b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87069) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:10:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Determined volume DB was empty at startup. Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87069) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 18:10:43 devstack cinder-volume[87069]: WARNING stevedore.named [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 18:10:43 devstack cinder-volume[87069]: WARNING castellan.key_manager [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:10:43 devstack cinder-volume[87069]: WARNING cinder.keymgr.conf_key_mgr [None req-00f488c6-26e0-44cb-b979-71292201008b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 18:10:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_db.sqlalchemy.engines [None req-00f488c6-26e0-44cb-b979-71292201008b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87069) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:10:43 devstack cinder-volume[87069]: INFO oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Starting 1 workers Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Started child 87309 {{(pid=87069) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Full set of CONF: {{(pid=87069) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] ******************************************************************************** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] Configuration options gathered from: {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] ================================================================================ {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 18:10:43 devstack cinder-volume[87309]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] allow_availability_zone_fallback = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] allow_compression_on_image_upload = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] allowed_direct_url_schemes = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] api_rate_limit = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] auth_strategy = keystone {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_availability_zone = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_host = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_stats_polling_interval = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backup_api_class = cinder.backup.api.API {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backup_name_template = backup-%s {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backup_use_same_host = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backup_use_temp_snapshot = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] chap_password = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] chap_username = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_internal_tenant_project_id = a08b1dd89b4c48c4946263504a9f721c {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_internal_tenant_user_id = 1e7cb44b5ae9422e80df60a7c017b08d {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cluster = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] compression_format = gzip {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] compute_api_class = cinder.compute.nova.API {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] config_dir = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] config_source = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] control_exchange = openstack {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] debug = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] default_availability_zone = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] default_group_type = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] default_volume_type = QuobyteHD {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] disk_geometry = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] driver_client_cert = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] driver_client_cert_key = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] driver_data_namespace = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] driver_ssl_cert_path = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] driver_ssl_cert_verify = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] driver_use_ssl = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] enable_new_services = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] enable_unsupported_driver = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] enabled_backends = ['QuobyteHD'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] enforce_multipath_for_image_xfer = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] filter_function = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_api_insecure = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_api_ssl_compression = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_ca_certificates_file = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_catalog_info = image:glance:publicURL {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_certfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_keyfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_num_retries = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance_request_timeout = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] goodness_function = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] graceful_shutdown_timeout = 5 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] group_api_class = cinder.group.api.API {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] host = devstack {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_compress_on_upload = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_conversion_address_space_limit = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_conversion_cpu_limit = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_conversion_disable = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_upload_use_cinder_backend = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_upload_use_internal_tenant = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_volume_cache_enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_volume_cache_max_count = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] image_volume_cache_max_size_gb = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] init_host_max_objects_retrieval = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] instance_format = [instance: %(uuid)s] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] iscsi_target_flags = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] iscsi_write_cache = on {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] iser_helper = tgtadm {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] iser_ip_address = 192.168.122.74 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] iser_port = 3260 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_color = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_config_append = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_dir = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87309) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_file = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_options = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_rotate_interval = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_rotate_interval_type = days {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] log_rotation_type = none {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] max_age = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] max_logfile_count = 30 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] max_logfile_size_mb = 200 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] max_over_subscription_ratio = 20.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] message_reap_interval = 86400 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] message_ttl = 2592000 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] migration_create_volume_timeout_secs = 300 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] monkey_patch = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] monkey_patch_modules = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] my_ip = 192.168.122.74 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] no_snapshot_gb_quota = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] num_iser_scan_tries = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] num_shell_tries = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] num_volume_device_scan_tries = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] nvmeof_conn_info_version = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] nvmet_ns_id = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] nvmet_port_id = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] osapi_max_limit = 1000 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] osapi_volume_ext_list = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] osapi_volume_listen = 0.0.0.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] osapi_volume_listen_port = 8776 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] osapi_volume_use_ssl = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] osapi_volume_workers = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] per_volume_size_limit = -1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] periodic_fuzzy_delay = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] periodic_interval = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] project_id_regex = [0-9a-f\-]+ {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] public_endpoint = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] publish_errors = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] quota_backup_gigabytes = 1000 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] quota_backups = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] quota_gigabytes = 1000 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] quota_groups = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] quota_snapshots = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] quota_volumes = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] rate_limit_burst = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] rate_limit_except_level = CRITICAL {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] rate_limit_interval = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] reinit_driver_count = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] replication_device = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] report_discard_supported = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] report_interval = 120 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] reservation_clean_interval = 86400 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] reservation_expire = 86400 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] reserved_image_namespaces = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] reserved_percentage = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] rpc_response_timeout = 120 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] run_external_periodic_tasks = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] scst_target_driver = iscsi {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] scst_target_iqn_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_down_time = 720 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] shell_completion = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] snapshot_name_template = snapshot-%s {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] split_loggers = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] state_path = /opt/stack/data/cinder {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] storage_availability_zone = nova {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] storage_protocol = iSCSI {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] syslog_log_facility = LOG_USER {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] target_helper = lioadm {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] target_ip_address = 192.168.122.74 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] target_port = 3260 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] target_protocol = iscsi {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] target_secondary_ip_addresses = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] trace_flags = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] transfer_api_class = cinder.transfer.api.API {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] transport_url = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] until_refresh = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] use_chap_auth = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] use_default_quota_class = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] use_journal = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] use_json = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] use_multipath_for_image_xfer = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] use_stderr = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] use_syslog = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] verify_glance_signatures = enabled {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_api_class = cinder.volume.api.API {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_backend_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_clear = zero {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_clear_ionice = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_clear_size = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_copy_bps_limit = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_dd_blocksize = 1M {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_name_template = volume-%s {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_service_inithost_offload = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volume_usage_audit_period = month {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] zoning_mode = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_concurrency.disable_process_locking = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.auth_section = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.auth_type = password {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.auth_version = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.cache = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.certfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.delay_auth_decision = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.http_connect_timeout = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.include_service_catalog = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.insecure = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.interface = public {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.keyfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_password = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:43 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcache_username = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.region_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.service_token_roles_required = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.service_type = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.token_cache_time = 300 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.backend = dogpile.cache.null {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.backend_argument = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.backend_expiration_time = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.config_prefix = cache.oslo {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.debug_cache_backend = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.enable_retry_client = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.enable_socket_keepalive = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.expiration_time = 600 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.hashclient_retry_attempts = 2 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.memcache_dead_retry = 300 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.memcache_pool_maxsize = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.memcache_sasl_enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.password = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.proxies = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.redis_db = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.redis_sentinel_service_name = mymaster {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.redis_server = localhost:6379 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.retry_attempts = 2 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.retry_delay = 0.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.socket_keepalive_count = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.socket_keepalive_idle = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.socket_keepalive_interval = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.socket_timeout = 1.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.tls_allowed_ciphers = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.tls_cafile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.tls_certfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.tls_enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.tls_keyfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cache.username = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] coordination.backend_url = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.asyncio_connection = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.asyncio_slave_connection = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.backend = sqlalchemy {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.connection = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.connection_debug = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87309) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.connection_parameters = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.connection_recycle_time = 3600 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.connection_trace = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.db_inc_retry_interval = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.db_max_retries = 20 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.db_max_retry_interval = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.db_retry_interval = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.max_overflow = 50 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.max_pool_size = 5 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.max_retries = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Running cmd (subprocess): mount.quobyte {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.mysql_wsrep_sync_wait = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.pool_timeout = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.retry_interval = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.slave_connection = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.sqlite_synchronous = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.synchronous_reader = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] database.use_db_reconnect = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.connection_string = messaging:// {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.es_doc_type = notification {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.es_scroll_size = 10000 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.es_scroll_time = 2m {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.filter_error_trace = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.hmac_keys = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.sentinel_service_name = mymaster {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.socket_timeout = 0.1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.trace_requests = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler.trace_sqlalchemy = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler_jaeger.process_tags = {} {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler_jaeger.service_name_prefix = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] profiler_otlp.service_name_prefix = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.enforce_new_defaults = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.enforce_scope = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.policy_default_rule = default {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.policy_file = policy.yaml {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_policy.remote_timeout = 60.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] privsep_osbrick.group = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] privsep_osbrick.helper_command = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] privsep_osbrick.user = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_sys_admin.group = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_sys_admin.helper_command = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] cinder_sys_admin.user = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.auth_section = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.auth_type = password {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.cafile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.certfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.collect_timing = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.insecure = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.keyfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.send_service_user_token = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.split_loggers = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] service_user.timeout = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.auth_section = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.auth_type = password {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.certfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.collect_timing = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.insecure = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.keyfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.region_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.split_loggers = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] glance.timeout = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.backend_availability_zone = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.chap_password = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.chap_username = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.disk_geometry = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.driver_client_cert = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.driver_client_cert_key = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.driver_data_namespace = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.driver_use_ssl = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.enable_unsupported_driver = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.extra_capabilities = {} {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.filter_function = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.goodness_function = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.iscsi_target_flags = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.iscsi_write_cache = on {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.iser_helper = tgtadm {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.iser_port = 3260 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_host = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_login = admin {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_mount_options = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_password = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_private_key = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_share_path = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_ssh_port = 22 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.num_shell_tries = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.nvmet_port_id = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.quobyte_client_cfg = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.quobyte_volume_url = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.replication_device = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.report_discard_supported = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.reserved_percentage = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.scst_target_driver = iscsi {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.scst_target_iqn_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.storage_protocol = iSCSI {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.target_helper = tgtadm {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.target_port = 3260 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.target_protocol = iscsi {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack quobyte-client[87310]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 18:10:44 devstack quobyte-client[87310]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.trace_flags = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.unique_fqdn_network = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.use_chap_auth = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volume_backend_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volume_clear = zero {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volume_clear_ionice = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volume_clear_size = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_reports.file_event_handler = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_reports.log_dir = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.backend_availability_zone = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.backend_host = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.chap_password = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.chap_username = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.chiscsi_conf = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.disk_geometry = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.driver_client_cert = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.driver_client_cert_key = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.driver_data_namespace = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.driver_use_ssl = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.extra_capabilities = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.filter_function = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.goodness_function = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.iscsi_target_flags = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.iscsi_write_cache = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.iser_helper = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.iser_ip_address = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.iser_port = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.iser_target_prefix = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_host = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_login = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_mount_options = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_password = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_private_key = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_share_path = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_ssh_port = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.num_shell_tries = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nvmet_ns_id = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.nvmet_port_id = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.replication_device = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.report_discard_supported = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.reserved_percentage = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.scst_target_driver = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.storage_protocol = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.target_helper = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.target_ip_address = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.target_port = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.target_prefix = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.target_protocol = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.trace_flags = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.unique_fqdn_network = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.use_chap_auth = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volume_clear = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volume_clear_ionice = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volume_clear_size = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] QuobyteHD.volumes_dir = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.ssl = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.ssl_version = {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_notifications.driver = [] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_notifications.retry = -1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] oslo_messaging_notifications.transport_url = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] key_manager.fixed_key = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.barbican_api_version = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.barbican_endpoint = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.barbican_endpoint_type = public {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.barbican_region_name = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.cafile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.certfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.collect_timing = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.insecure = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.keyfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.number_of_retries = 60 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.retry_delay = 1 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.send_service_user_token = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.split_loggers = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.timeout = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.verify_ssl = True {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican.verify_ssl_path = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.auth_section = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.auth_type = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.cafile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.certfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.collect_timing = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.insecure = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.keyfile = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.split_loggers = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] barbican_service_user.timeout = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.approle_role_id = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.approle_secret_id = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.kv_mountpoint = secret {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.kv_path = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.kv_version = 2 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.namespace = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.root_token_id = **** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.ssl_ca_crt_file = None {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.timeout = 60.0 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.use_ssl = False {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 18:10:44 devstack cinder-volume[87069]: DEBUG oslo_service.backend._eventlet.service [None req-00f488c6-26e0-44cb-b979-71292201008b None None] ******************************************************************************** {{(pid=87069) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 18:10:44 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.651s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:44 devstack cinder-volume[87309]: INFO cinder.volume.driver [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG cinder.volume.driver [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87309) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_db.sqlalchemy.engines [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writer thread running {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG cinder.db.api [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Building query based on filter {{(pid=87309) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87309) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:10:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:44 devstack cinder-volume[87309]: INFO cinder.keymgr.migration [None req-b941c795-b5ac-460c-9224-548893f661f1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 18:10:44 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:10:44 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:10:45 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.633s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:10:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Driver initialization completed successfully. Jul 08 18:10:45 devstack cinder-volume[87309]: INFO cinder.manager [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Initiating service 3 cleanup Jul 08 18:10:45 devstack cinder-volume[87309]: INFO cinder.manager [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Service 3 cleanup completed. Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG cinder.service [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Creating RPC server for service cinder-volume {{(pid=87309) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG cinder.service [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87309) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 18:10:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:10:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:10:45 devstack sudo[87355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:10:45 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:10:46 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root Jul 08 18:10:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.625s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:10:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-af13509f-e763-4179-b665-1f8a4ae3da21 None None] Driver post RPC initialization completed successfully. Jul 08 18:10:53 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:10:55 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:10:56 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:11:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:11:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 6 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:11:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Flow 'volume_create_manager' (2b42d750-e9ce-4cf3-94aa-338ecb75b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16a432a-be5d-42ac-aabb-8efc5b92efdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16a432a-be5d-42ac-aabb-8efc5b92efdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1481387981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69908be3-9707-4063-b953-85cb3a087777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20deb456a3c844389a034b556e6bf623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:11:41Z,use_quota=True,user_id='4ad9819cee674740aed9f6c281e116be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35eac3ab-bd8a-42ba-bb91-561c4ee4da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35eac3ab-bd8a-42ba-bb91-561c4ee4da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ef9631-1c1e-42cd-a1fc-135176b49fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ef9631-1c1e-42cd-a1fc-135176b49fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69908be3-9707-4063-b953-85cb3a087777', 'volume_name': 'volume-69908be3-9707-4063-b953-85cb3a087777', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee09b985-5a5c-4c58-9f91-de6fbc8003b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee09b985-5a5c-4c58-9f91-de6fbc8003b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45559fd6-2670-4eca-aa8b-9762ff03fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:11:41 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Volume 69908be3-9707-4063-b953-85cb3a087777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69908be3-9707-4063-b953-85cb3a087777', 'volume_size': 1} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1481387981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69908be3-9707-4063-b953-85cb3a087777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20deb456a3c844389a034b556e6bf623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:11:41Z,use_quota=True,user_id='4ad9819cee674740aed9f6c281e116be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Creating volume 69908be3-9707-4063-b953-85cb3a087777 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:11:41 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:11:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:11:41 devstack sudo[87536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 1073741824 Jul 08 18:11:41 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:11:42 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root Jul 08 18:11:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 1073741824" returned: 0 in 1.057s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:11:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:11:42 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 Jul 08 18:11:42 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:11:43 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Jul 08 18:11:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777" returned: 0 in 0.679s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:11:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:11:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:11:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45559fd6-2670-4eca-aa8b-9762ff03fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69908be3-9707-4063-b953-85cb3a087777', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:11:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b68647c-0b8a-4b6f-b35e-0a0b360ac20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:11:43 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Volume volume-69908be3-9707-4063-b953-85cb3a087777 (69908be3-9707-4063-b953-85cb3a087777): created successfully Jul 08 18:11:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b68647c-0b8a-4b6f-b35e-0a0b360ac20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:11:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Flow 'volume_create_manager' (2b42d750-e9ce-4cf3-94aa-338ecb75b69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:11:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6646abf7-a052-45e0-9c23-5e4fc989bff8 tempest-TaggedAttachmentsTest-771704255 None] Created volume successfully. Jul 08 18:11:53 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:11:53 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:12:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:12:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:12:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:12:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:12:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:12:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:12:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:02 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:12:02 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:03 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.967s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 6 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Flow 'volume_create_manager' (2d212c89-97df-47c8-9d52-f7063a238b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d667f468-5f06-4a2b-b947-4275b3bfc819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d667f468-5f06-4a2b-b947-4275b3bfc819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-117999543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb4658d-7585-4e39-9595-cbadf49dca5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4855885e66e1405bb5d47686cafb569c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:12:03Z,use_quota=True,user_id='67d2832ef5b14de8b374eec24f807488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541e4fb8-17d9-42be-b36d-b09d9f349c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541e4fb8-17d9-42be-b36d-b09d9f349c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02c7768-e660-4a09-9fb7-2cfcb441b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02c7768-e660-4a09-9fb7-2cfcb441b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb4658d-7585-4e39-9595-cbadf49dca5c', 'volume_name': 'volume-2eb4658d-7585-4e39-9595-cbadf49dca5c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2d51d9-4f75-4dcb-8d84-de930e54329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2d51d9-4f75-4dcb-8d84-de930e54329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca887fb-66bc-4d42-9c36-5b620b1ebbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:03 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Volume 2eb4658d-7585-4e39-9595-cbadf49dca5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb4658d-7585-4e39-9595-cbadf49dca5c', 'volume_size': 1} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-117999543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb4658d-7585-4e39-9595-cbadf49dca5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4855885e66e1405bb5d47686cafb569c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:12:03Z,use_quota=True,user_id='67d2832ef5b14de8b374eec24f807488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Creating volume 2eb4658d-7585-4e39-9595-cbadf49dca5c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:12:03 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:12:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:03 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c 1073741824 Jul 08 18:12:03 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:04 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c 1073741824" returned: 0 in 1.316s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:05 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c Jul 08 18:12:05 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:06 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c" returned: 0 in 1.090s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:12:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:12:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca887fb-66bc-4d42-9c36-5b620b1ebbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb4658d-7585-4e39-9595-cbadf49dca5c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4767cce0-4f74-4acb-a5f0-d2ebfdba0dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:06 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Volume volume-2eb4658d-7585-4e39-9595-cbadf49dca5c (2eb4658d-7585-4e39-9595-cbadf49dca5c): created successfully Jul 08 18:12:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4767cce0-4f74-4acb-a5f0-d2ebfdba0dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Flow 'volume_create_manager' (2d212c89-97df-47c8-9d52-f7063a238b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:12:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4111782a-9208-4edd-84fb-e6fbbcc12a72 tempest-DeleteServersTestJSON-1542653744 None] Created volume successfully. Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING py.warnings [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 08 18:12:14 devstack cinder-volume[87309]: .first() Jul 08 18:12:14 devstack cinder-volume[87309]: Jul 08 18:12:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:12:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:12:14 devstack cinder-volume[87309]: INFO oslo.privsep.daemon [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw6xr7sot/privsep.sock'] Jul 08 18:12:14 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw6xr7sot/privsep.sock Jul 08 18:12:14 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:12:14 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 18:12:15 devstack cinder-volume[87309]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 18:12:16 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:16 devstack cinder-volume[87309]: INFO oslo.privsep.daemon [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] Spawned new privsep daemon via rootwrap Jul 08 18:12:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] Accepted privsep connection to /tmp/tmpw6xr7sot/privsep.sock {{(pid=87309) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 18:12:16 devstack cinder-volume[87309]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 18:12:16 devstack cinder-volume[87309]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 18:12:16 devstack cinder-volume[87309]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 18:12:16 devstack cinder-volume[87309]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88287 Jul 08 18:12:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[887c1b60-7a46-47de-9016-d9d4cdc13c95]: (2,) {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:12:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8763636b-4aee-4a1e-912f-9371bef029db]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:12:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:16 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c Jul 08 18:12:16 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:17 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c" returned: 0 in 1.243s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.659s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:12:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-2eb4658d-7585-4e39-9595-cbadf49dca5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ea42876-d810-497a-a92d-86ad8d2d4163', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:12:17 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-04d15f1b-72c1-4408-92a2-2c7c73c5a08a req-ee89f31a-36be-47e5-9ddd-22745e9c8151 tempest-DeleteServersTestJSON-1542653744 None] attachment_update completed successfully. Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Flow 'volume_create_manager' (7ddbf805-62d5-4824-acf2-3b35e5b2390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08f19e6-273d-4f17-b15d-a0d6ab9a438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08f19e6-273d-4f17-b15d-a0d6ab9a438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-49694235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03865f1f-b9a0-42a6-a481-5d2b61f2b7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca70c6c819b04187aa022eb014891760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:12:24Z,use_quota=True,user_id='dabd0114d90f451bbff3aa51e7494211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa4cfa0-9d1d-451c-881d-b4fecc1e0871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa4cfa0-9d1d-451c-881d-b4fecc1e0871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70beb1f1-f0fe-4225-aac4-692c5ad06eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70beb1f1-f0fe-4225-aac4-692c5ad06eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03865f1f-b9a0-42a6-a481-5d2b61f2b7a4', 'volume_name': 'volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73ed4b5-7aaf-447a-ad9d-51c158c09c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73ed4b5-7aaf-447a-ad9d-51c158c09c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e2dbb6-a068-40c0-b7ac-5031937f754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:23 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Volume 03865f1f-b9a0-42a6-a481-5d2b61f2b7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4', 'volume_size': 1} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-49694235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03865f1f-b9a0-42a6-a481-5d2b61f2b7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca70c6c819b04187aa022eb014891760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:12:24Z,use_quota=True,user_id='dabd0114d90f451bbff3aa51e7494211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:12:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Creating volume 03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:12:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:12:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:12:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:12:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:12:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:12:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:12:24 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:12:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:24 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 1073741824 Jul 08 18:12:24 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:26 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 1073741824" returned: 0 in 2.159s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:26 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 Jul 08 18:12:26 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:27 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4" returned: 0 in 1.538s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] <== create_volume: return (3807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:12:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.812s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:12:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e2dbb6-a068-40c0-b7ac-5031937f754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a50fe7-4706-4ed5-bb6e-4dc29c0efb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:12:27 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Volume volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 (03865f1f-b9a0-42a6-a481-5d2b61f2b7a4): created successfully Jul 08 18:12:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a50fe7-4706-4ed5-bb6e-4dc29c0efb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:12:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Flow 'volume_create_manager' (7ddbf805-62d5-4824-acf2-3b35e5b2390a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:12:27 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9953553d-1666-4861-a3c0-0849c2844307 tempest-VolumesAdminNegativeTest-1396085814 None] Created volume successfully. Jul 08 18:12:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Acquiring lock "cinder-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:12:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "cinder-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:12:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Acquiring lock "cinder-quobyte-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:12:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "cinder-quobyte-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:12:29 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eda33b8-aa1b-492a-ab3d-659b6557525e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:12:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:29 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 Jul 08 18:12:29 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:30 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4" returned: 0 in 1.137s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:30 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4 Jul 08 18:12:30 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-10cc5130-789d-412d-9ec1-8886067b4f62 req-7f8ae23c-3963-48bf-9802-3e73e57fc669 tempest-DeleteServersTestJSON-1542653744 None] Terminate volume connection completed successfully. Jul 08 18:12:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-10cc5130-789d-412d-9ec1-8886067b4f62 req-7f8ae23c-3963-48bf-9802-3e73e57fc669 tempest-DeleteServersTestJSON-1542653744 None] Deleting attachment 3ea42876-d810-497a-a92d-86ad8d2d4163. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:12:32 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4" returned: 0 in 1.280s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "cinder-quobyte-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4" released by "delete_volume" :: held 2.557s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:12:32 devstack cinder-volume[87309]: WARNING cinder.quota [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:12:32 devstack cinder-volume[87309]: WARNING cinder.quota [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Created reservations ['c211177d-b484-4929-9112-66e1ae542f44', '4f29bf7f-7134-4b98-b56d-8e93d3df80bf', 'b8d621d7-31fa-4ff7-9db9-0b1f2afb0c51', '4a46c197-8e75-4002-8e71-c0c30db5dab3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:12:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:32 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:12:32 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:33 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.558s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:33 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:12:33 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Deleted volume successfully. Jul 08 18:12:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc83da24-3122-4670-b042-cc6ab8c04592 tempest-VolumesAdminNegativeTest-1396085814 None] Lock "cinder-03865f1f-b9a0-42a6-a481-5d2b61f2b7a4-delete_volume" released by "delete_volume" :: held 4.615s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:12:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Acquiring lock "cinder-2eb4658d-7585-4e39-9595-cbadf49dca5c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:12:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Lock "cinder-2eb4658d-7585-4e39-9595-cbadf49dca5c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:12:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Acquiring lock "cinder-quobyte-2eb4658d-7585-4e39-9595-cbadf49dca5c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:12:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Lock "cinder-quobyte-2eb4658d-7585-4e39-9595-cbadf49dca5c" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:12:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d9a3a5-6321-426c-ab8e-951c47262224]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:12:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:35 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c Jul 08 18:12:35 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:36 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c" returned: 0 in 0.897s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:36 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c Jul 08 18:12:36 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:37 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2eb4658d-7585-4e39-9595-cbadf49dca5c" returned: 0 in 0.775s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Lock "cinder-quobyte-2eb4658d-7585-4e39-9595-cbadf49dca5c" released by "delete_volume" :: held 1.737s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Created reservations ['20f998ba-4587-415d-b0d3-47bd4ca7b62d', 'c241c106-4e8e-4542-9c21-224bb96a4ee7', '2c3a1cb9-4958-4f93-9740-47aa68818658', 'e14cafc7-ede8-431f-a666-150cf52961e3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:12:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:12:37 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:12:37 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:12:38 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Jul 08 18:12:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.709s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:12:38 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:12:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Deleted volume successfully. Jul 08 18:12:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec251939-cf38-490e-9697-bd323a85ec1f tempest-DeleteServersTestJSON-1542653744 None] Lock "cinder-2eb4658d-7585-4e39-9595-cbadf49dca5c-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:12:56 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=22,cinder:SELECT=21,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:12:56 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:13:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:13:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:13:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:13:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:02 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:13:02 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:03 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.388s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:13:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:13:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 8 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:13:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:13:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d6cbf5cc-df40-42f4-a779-3aba6f5b7cdb req-64ef9aca-1c21-4866-83cc-09f1f6785193 tempest-TaggedAttachmentsTest-771704255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d6cbf5cc-df40-42f4-a779-3aba6f5b7cdb req-64ef9aca-1c21-4866-83cc-09f1f6785193 tempest-TaggedAttachmentsTest-771704255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:05 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[70053129-8ddf-492c-8ff8-2d1a5a05b453]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-d6cbf5cc-df40-42f4-a779-3aba6f5b7cdb req-64ef9aca-1c21-4866-83cc-09f1f6785193 tempest-TaggedAttachmentsTest-771704255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:06 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 Jul 08 18:13:06 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:07 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-d6cbf5cc-df40-42f4-a779-3aba6f5b7cdb req-64ef9aca-1c21-4866-83cc-09f1f6785193 tempest-TaggedAttachmentsTest-771704255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777" returned: 0 in 1.191s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d6cbf5cc-df40-42f4-a779-3aba6f5b7cdb req-64ef9aca-1c21-4866-83cc-09f1f6785193 tempest-TaggedAttachmentsTest-771704255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.216s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d6cbf5cc-df40-42f4-a779-3aba6f5b7cdb req-64ef9aca-1c21-4866-83cc-09f1f6785193 tempest-TaggedAttachmentsTest-771704255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-69908be3-9707-4063-b953-85cb3a087777', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f69fa464-83d2-4615-8846-6a34faa25a19', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:13:07 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-d6cbf5cc-df40-42f4-a779-3aba6f5b7cdb req-64ef9aca-1c21-4866-83cc-09f1f6785193 tempest-TaggedAttachmentsTest-771704255 None] attachment_update completed successfully. Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Flow 'volume_create_manager' (85390a1a-37cf-4024-a9bb-304c9b465da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c292d0-8519-4a0d-b8f6-ca47e8edeb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c292d0-8519-4a0d-b8f6-ca47e8edeb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-916696008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f561e863-fabc-458f-b066-1be00f7b3a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05e328996194a78948291c1b686ed05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:13:09Z,use_quota=True,user_id='81a8012be86142a8be7d54012c0e3855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5294e6a-528e-4933-a61c-52122e9681a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5294e6a-528e-4933-a61c-52122e9681a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9571e886-0884-4951-86ab-558971a019aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9571e886-0884-4951-86ab-558971a019aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f561e863-fabc-458f-b066-1be00f7b3a1e', 'volume_name': 'volume-f561e863-fabc-458f-b066-1be00f7b3a1e', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1e85b1-1926-47a1-ac59-b5fe853025ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1e85b1-1926-47a1-ac59-b5fe853025ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637368eb-300d-42c9-b7d4-05ab6c78b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:09 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Volume f561e863-fabc-458f-b066-1be00f7b3a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f561e863-fabc-458f-b066-1be00f7b3a1e', 'volume_size': 1} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-916696008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f561e863-fabc-458f-b066-1be00f7b3a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05e328996194a78948291c1b686ed05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:13:09Z,use_quota=True,user_id='81a8012be86142a8be7d54012c0e3855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Creating volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:13:09 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e 1073741824 Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:13:09 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:13:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:09 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:10 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e 1073741824" returned: 0 in 1.104s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:10 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e Jul 08 18:13:10 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:11 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e" returned: 0 in 1.019s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:13:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637368eb-300d-42c9-b7d4-05ab6c78b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f561e863-fabc-458f-b066-1be00f7b3a1e', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2853b5e2-cad4-4c2b-a43a-b4dd27a3e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:11 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Volume volume-f561e863-fabc-458f-b066-1be00f7b3a1e (f561e863-fabc-458f-b066-1be00f7b3a1e): created successfully Jul 08 18:13:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2853b5e2-cad4-4c2b-a43a-b4dd27a3e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Flow 'volume_create_manager' (85390a1a-37cf-4024-a9bb-304c9b465da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:13:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5fc36b9c-02c4-401e-95bb-de4ad71ed872 tempest-SnapshotsActionsTest-808160107 None] Created volume successfully. Jul 08 18:13:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Creating offline snapshot 13ad6319-5a70-400e-8278-0a4b5e7c718f of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:13:13 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cb2e39-fb5f-418b-afae-a69a2e57debf]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:13 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e Jul 08 18:13:13 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:14 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e" returned: 0 in 1.176s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:14 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f 1G Jul 08 18:13:14 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-9cd0e7ce-934a-4c46-9f50-d62bdcf0912e req-9e99b148-d529-4062-ac0e-8257850f8ea9 tempest-TaggedAttachmentsTest-771704255 None] Terminate volume connection completed successfully. Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9cd0e7ce-934a-4c46-9f50-d62bdcf0912e req-9e99b148-d529-4062-ac0e-8257850f8ea9 tempest-TaggedAttachmentsTest-771704255 None] Deleting attachment f69fa464-83d2-4615-8846-6a34faa25a19. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Flow 'volume_create_manager' (2d5082a3-d7ce-4963-85a2-31c18e928822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580641e1-9a9c-49fa-a95b-7d92b61c8461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580641e1-9a9c-49fa-a95b-7d92b61c8461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-581934696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e52b35b-0a62-413e-8652-ce6ca7a6c855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eee01232d6c4db58d009debd3dbfdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:13:15Z,use_quota=True,user_id='71b0ff77491c4064b853572ac5b49fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fe490a-2936-407f-9b4b-cd3b6ec1fb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fe490a-2936-407f-9b4b-cd3b6ec1fb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816ee35d-3218-467d-b46a-a08ebc5af7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816ee35d-3218-467d-b46a-a08ebc5af7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e52b35b-0a62-413e-8652-ce6ca7a6c855', 'volume_name': 'volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b9d7a5-2c01-4789-b3b7-1cdd898a8ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b9d7a5-2c01-4789-b3b7-1cdd898a8ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b0a936-c0ee-4fe2-b090-a98ce25eae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:14 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Volume 2e52b35b-0a62-413e-8652-ce6ca7a6c855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855', 'volume_size': 1} Jul 08 18:13:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:15 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f 1G" returned: 0 in 1.405s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:15 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:13:15 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:16 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 1.049s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:16 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f is being set with open permissions: ugo+rw Jul 08 18:13:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:16 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:13:16 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:17 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 0.956s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:17 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.info Jul 08 18:13:17 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:19 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.info" returned: 0 in 1.374s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:19 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.info is being set with open permissions: ugo+rw Jul 08 18:13:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:19 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.info Jul 08 18:13:19 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:20 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.info" returned: 0 in 1.016s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.125s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.238s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-581934696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e52b35b-0a62-413e-8652-ce6ca7a6c855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eee01232d6c4db58d009debd3dbfdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:13:15Z,use_quota=True,user_id='71b0ff77491c4064b853572ac5b49fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Creating volume 2e52b35b-0a62-413e-8652-ce6ca7a6c855 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:13:20 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:13:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:20 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-09d978a9-c268-4cd8-98cc-fba18903414b tempest-SnapshotsActionsTest-808160107 None] Create snapshot completed successfully Jul 08 18:13:20 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 1073741824 Jul 08 18:13:20 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:21 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 1073741824" returned: 0 in 1.457s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:21 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 Jul 08 18:13:21 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:23 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855" returned: 0 in 1.638s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] <== create_volume: return (3211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.216s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.500s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b0a936-c0ee-4fe2-b090-a98ce25eae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db54235-4246-4c9e-827f-7ad682e35dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:13:23 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Volume volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 (2e52b35b-0a62-413e-8652-ce6ca7a6c855): created successfully Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db54235-4246-4c9e-827f-7ad682e35dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Flow 'volume_create_manager' (2d5082a3-d7ce-4963-85a2-31c18e928822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Creating offline snapshot 103988b8-b444-4c9d-9f92-845928da9b19 of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:13:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b214a053-81cf-4642-ae12-f127e9264c31 tempest-ServerRescueNegativeTestJSON-1371251574 None] Created volume successfully. Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0b6fcd-c6e6-4ba8-8e72-bb6b7f1e09c0]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:23 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:13:23 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:24 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 0.987s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:24 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 1G Jul 08 18:13:24 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:25 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 1G" returned: 0 in 1.186s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:25 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 Jul 08 18:13:25 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:27 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19" returned: 0 in 1.272s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:27 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 is being set with open permissions: ugo+rw Jul 08 18:13:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:27 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 Jul 08 18:13:27 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:27 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19" returned: 0 in 0.692s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.494s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:27 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4ebc32a8-e3df-4bac-9e53-45c8ab55e4f8 tempest-SnapshotsActionsTest-808160107 None] Create snapshot completed successfully Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-103988b8-b444-4c9d-9f92-845928da9b19-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-103988b8-b444-4c9d-9f92-845928da9b19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-quobyte-103988b8-b444-4c9d-9f92-845928da9b19" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-103988b8-b444-4c9d-9f92-845928da9b19" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Deleting offline snapshot 103988b8-b444-4c9d-9f92-845928da9b19 of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] snapshot_file for this snap is: volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b91e3-1e27-46f8-989d-3881174bfd0c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:28 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 Jul 08 18:13:28 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:29 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19" returned: 0 in 0.902s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:29 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5da32e-606e-484f-bb32-cdd635f8a76c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:29 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:13:29 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:30 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 0.926s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:30 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 Jul 08 18:13:30 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:31 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19" returned: 0 in 0.732s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:31 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19 Jul 08 18:13:31 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:31 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.103988b8-b444-4c9d-9f92-845928da9b19" returned: 0 in 0.641s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-103988b8-b444-4c9d-9f92-845928da9b19" released by "_delete_snapshot" :: held 3.347s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" released by "delete_snapshot" :: held 3.372s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:31 devstack cinder-volume[87309]: WARNING cinder.quota [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:13:31 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Created reservations ['544c781a-10e3-4ebc-89b0-c44881d32d57', '15379861-0e23-4a72-a9aa-b87bb7e60781', '187606d7-82a1-4f92-af6d-d7fb1dc58509', '8087b62f-fe0a-494f-8b8e-bb1ce1e26ab6'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:13:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Delete snapshot completed successfully. Jul 08 18:13:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8247cf92-be18-44c3-8c20-95e3e1d73082 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-103988b8-b444-4c9d-9f92-845928da9b19-delete_snapshot" released by "delete_snapshot" :: held 3.536s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Creating offline snapshot 81794ba8-ad9c-4993-98d1-721f2955d944 of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:13:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfc5584-46c6-459d-8610-e75876e03cef]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:33 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:13:33 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:34 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 1.202s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:34 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 1G Jul 08 18:13:34 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:35 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 1G" returned: 0 in 1.630s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:35 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 Jul 08 18:13:35 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:36 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944" returned: 0 in 0.902s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:36 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 is being set with open permissions: ugo+rw Jul 08 18:13:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:36 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 Jul 08 18:13:36 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Acquiring lock "cinder-69908be3-9707-4063-b953-85cb3a087777-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Lock "cinder-69908be3-9707-4063-b953-85cb3a087777-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Acquiring lock "cinder-quobyte-69908be3-9707-4063-b953-85cb3a087777" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Lock "cinder-quobyte-69908be3-9707-4063-b953-85cb3a087777" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:37 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ac8a5-3929-4378-81ee-06eef0d8eff4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:37 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944" returned: 0 in 1.226s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.143s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:38 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 Jul 08 18:13:38 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-32bbc9b2-8748-4b9d-98d1-4b11e6789c3c tempest-SnapshotsActionsTest-808160107 None] Create snapshot completed successfully Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-81794ba8-ad9c-4993-98d1-721f2955d944-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-81794ba8-ad9c-4993-98d1-721f2955d944-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-quobyte-81794ba8-ad9c-4993-98d1-721f2955d944" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-81794ba8-ad9c-4993-98d1-721f2955d944" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Deleting offline snapshot 81794ba8-ad9c-4993-98d1-721f2955d944 of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] snapshot_file for this snap is: volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0456af-f5a1-4073-a947-26fc36cbdb51]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:38 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 Jul 08 18:13:38 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:38 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777" returned: 0 in 1.003s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:38 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777 Jul 08 18:13:38 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:39 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944" returned: 0 in 0.894s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:39 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9263c131-d6f6-425d-871e-03b895919c33]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:39 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:13:39 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:39 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69908be3-9707-4063-b953-85cb3a087777" returned: 0 in 1.032s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Lock "cinder-quobyte-69908be3-9707-4063-b953-85cb3a087777" released by "delete_volume" :: held 2.112s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Created reservations ['f6d76d74-c2b6-4ad6-8ef4-30d90a0a63a6', 'b623b7f5-63a2-4329-9125-895587eee2e3', 'ba39d318-fdad-4e9e-9296-bb9300affc7f', '53aa63fa-d571-4ebc-91ff-d4ada33ecb29'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:40 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:13:40 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:40 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 0.979s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:40 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 Jul 08 18:13:40 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:41 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.065s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:41 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:13:41 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Deleted volume successfully. Jul 08 18:13:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a6653b3-9cb7-4293-a1d7-9f37f01eeac4 tempest-TaggedAttachmentsTest-771704255 None] Lock "cinder-69908be3-9707-4063-b953-85cb3a087777-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:41 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944" returned: 0 in 1.214s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:41 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944 Jul 08 18:13:41 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:42 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.81794ba8-ad9c-4993-98d1-721f2955d944" returned: 0 in 1.000s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-81794ba8-ad9c-4993-98d1-721f2955d944" released by "_delete_snapshot" :: held 4.238s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" released by "delete_snapshot" :: held 4.270s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:42 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Created reservations ['9631c88c-08cb-4fa4-93fd-0fcd15c5f9be', 'c1a43ff0-594f-45b1-aad2-79fbdee2afdc', 'd931d458-913e-45ed-8b2b-713224322df6', '812959ac-b9ff-4e70-880b-51439c02cb1d'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:13:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Delete snapshot completed successfully. Jul 08 18:13:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-57ee80db-a6ff-4dd5-a14d-84498d9b7955 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-81794ba8-ad9c-4993-98d1-721f2955d944-delete_snapshot" released by "delete_snapshot" :: held 4.495s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Creating offline snapshot c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:13:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8bbb1f-47ab-4c9d-912d-5578ac174130]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:44 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:13:44 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Acquiring lock "cinder-2e52b35b-0a62-413e-8652-ce6ca7a6c855-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "cinder-2e52b35b-0a62-413e-8652-ce6ca7a6c855-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Acquiring lock "cinder-quobyte-2e52b35b-0a62-413e-8652-ce6ca7a6c855" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "cinder-quobyte-2e52b35b-0a62-413e-8652-ce6ca7a6c855" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[14046b19-b5e9-4241-86af-6c8111aec37b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:45 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 Jul 08 18:13:45 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:46 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 1.917s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:46 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 1G Jul 08 18:13:46 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:46 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855" returned: 0 in 1.724s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:47 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855 Jul 08 18:13:47 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:48 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2e52b35b-0a62-413e-8652-ce6ca7a6c855" returned: 0 in 1.549s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "cinder-quobyte-2e52b35b-0a62-413e-8652-ce6ca7a6c855" released by "delete_volume" :: held 3.469s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:48 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 1G" returned: 0 in 2.111s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:48 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 Jul 08 18:13:48 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:48 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Created reservations ['3e427307-0bf8-40e1-b18f-4732b9be7ded', '90f0396c-dcda-4845-bf1c-b7cde82634b2', 'edf8bb98-6946-4102-b47c-7c4e00f01b61', '177d72f0-b3ce-4a11-b72e-29ebb3701205'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:13:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:13:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:13:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:13:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:13:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:49 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:13:49 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:50 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9" returned: 0 in 1.627s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:50 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 is being set with open permissions: ugo+rw Jul 08 18:13:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:50 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:50 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 Jul 08 18:13:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.326s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:50 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:50 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:13:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Deleted volume successfully. Jul 08 18:13:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-62a271ef-4ca5-4835-b3bc-d297d85d10e1 tempest-ServerRescueNegativeTestJSON-1371251574 None] Lock "cinder-2e52b35b-0a62-413e-8652-ce6ca7a6c855-delete_volume" released by "delete_volume" :: held 5.458s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:52 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9" returned: 0 in 2.005s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.987s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:13:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c4fc1ac1-ecd0-43eb-ad83-846a575cf095 tempest-SnapshotsActionsTest-808160107 None] Create snapshot completed successfully Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-quobyte-c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Deleting offline snapshot c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] snapshot_file for this snap is: volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07fcea-e226-4291-8196-efc821a84315]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:54 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 Jul 08 18:13:54 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:55 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9" returned: 0 in 1.996s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:55 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb175fc-5169-4807-adb5-56fd148c7ae0]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:13:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:56 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:13:56 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:57 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 1.584s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:13:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:57 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 Jul 08 18:13:57 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:58 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9" returned: 0 in 1.252s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:13:58 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9 Jul 08 18:13:58 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:13:59 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Jul 08 18:13:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9" returned: 0 in 0.990s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:13:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9" released by "_delete_snapshot" :: held 5.984s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" released by "delete_snapshot" :: held 6.029s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:13:59 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=41,cinder:UPDATE=36,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:13:59 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Created reservations ['afc0da23-df75-4bc0-9b6b-32309cf1b5f3', 'bd9c214e-6418-4d39-a678-1fbaa36040a5', '6e58755b-2564-4b63-84eb-6282220fdff3', '69f9e616-7930-4b1a-89d2-1399ae25f725'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:13:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Delete snapshot completed successfully. Jul 08 18:13:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b078dda-d26b-48eb-8054-3c821bcbd752 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-c732c1c2-bcb8-45c3-9f0f-9ac20547e7c9-delete_snapshot" released by "delete_snapshot" :: held 6.203s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:14:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:14:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Creating offline snapshot 734d84db-9610-4269-8aec-0cbc277ea706 of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:14:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e980b61-1067-4fe5-8ce8-68483ac43907]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:00 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:14:00 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:01 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 0.990s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:14:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:01 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 1G Jul 08 18:14:01 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:02 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:14:02 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:02 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 1G" returned: 0 in 1.054s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:02 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 Jul 08 18:14:02 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:03 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.763s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:14:03 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706" returned: 0 in 0.800s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:03 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 is being set with open permissions: ugo+rw Jul 08 18:14:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:03 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 Jul 08 18:14:03 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:04 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706" returned: 0 in 0.735s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.684s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:14:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-888aeaf4-48b8-442c-9d4d-ea872e188f91 tempest-SnapshotsActionsTest-808160107 None] Create snapshot completed successfully Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-734d84db-9610-4269-8aec-0cbc277ea706-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-734d84db-9610-4269-8aec-0cbc277ea706-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Acquiring lock "cinder-quobyte-734d84db-9610-4269-8aec-0cbc277ea706" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-734d84db-9610-4269-8aec-0cbc277ea706" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Deleting offline snapshot 734d84db-9610-4269-8aec-0cbc277ea706 of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] snapshot_file for this snap is: volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6d690-9421-41f9-9346-3eb6e3cc34e2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:04 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 Jul 08 18:14:04 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:05 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706" returned: 0 in 0.819s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:14:05 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b657e11b-8295-435a-855e-c34e4cb857c5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:05 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:14:05 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:06 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 1.081s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:14:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:06 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 Jul 08 18:14:06 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:07 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706" returned: 0 in 0.905s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:07 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706 Jul 08 18:14:07 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:08 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.734d84db-9610-4269-8aec-0cbc277ea706" returned: 0 in 0.736s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-734d84db-9610-4269-8aec-0cbc277ea706" released by "_delete_snapshot" :: held 3.635s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" released by "delete_snapshot" :: held 3.658s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:08 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=50,cinder:UPDATE=48,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:14:08 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Created reservations ['87e1b1bc-377d-40fd-af9c-7d16f944912f', 'd51ee6e4-efba-459b-8e56-7c309861dcef', '3ee29a3a-dee0-4793-b30e-4559f1bc19da', '78300deb-8388-457e-8f5c-075454cd4081'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:14:08 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Delete snapshot completed successfully. Jul 08 18:14:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1cd75ab1-25f7-4951-8eb2-f5a502588557 tempest-SnapshotsActionsTest-393384588 None] Lock "cinder-734d84db-9610-4269-8aec-0cbc277ea706-delete_snapshot" released by "delete_snapshot" :: held 3.849s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "cinder-13ad6319-5a70-400e-8278-0a4b5e7c718f-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-13ad6319-5a70-400e-8278-0a4b5e7c718f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "cinder-quobyte-13ad6319-5a70-400e-8278-0a4b5e7c718f" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-quobyte-13ad6319-5a70-400e-8278-0a4b5e7c718f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Deleting offline snapshot 13ad6319-5a70-400e-8278-0a4b5e7c718f of volume f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] snapshot_file for this snap is: volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d45bcf7-ce08-44dc-8512-6efb23bf41dc]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:09 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:14:09 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:10 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 0.887s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f561e863-fabc-458f-b066-1be00f7b3a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:14:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac869a8-34cb-4b26-80ba-5533c34d7df4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:10 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e Jul 08 18:14:10 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:11 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e" returned: 0 in 1.221s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:11 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:14:11 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:12 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 1.010s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:12 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f Jul 08 18:14:12 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:13 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e.13ad6319-5a70-400e-8278-0a4b5e7c718f" returned: 0 in 0.797s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-quobyte-13ad6319-5a70-400e-8278-0a4b5e7c718f" released by "_delete_snapshot" :: held 4.061s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" released by "delete_snapshot" :: held 4.097s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:13 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Created reservations ['ef79365c-36b4-4567-b0d3-3b072b89daa9', 'ee42e17b-a11d-48ef-bd5e-e36b7c6b46a1', '390f32c0-b8ac-45ba-b66e-f161ac2d0223', 'c293a909-385d-4971-bdc2-b32ba3891073'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:14:13 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Delete snapshot completed successfully. Jul 08 18:14:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab9d5812-0a7c-46e1-b474-bca3460f800a tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-13ad6319-5a70-400e-8278-0a4b5e7c718f-delete_snapshot" released by "delete_snapshot" :: held 4.276s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Flow 'volume_create_manager' (14135007-7531-4f6e-8127-7c24e5123ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4848667-9ad7-419a-9416-d6f19d2aaf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "cinder-f561e863-fabc-458f-b066-1be00f7b3a1e-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4848667-9ad7-419a-9416-d6f19d2aaf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-440771182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf6113b-a3fb-47b0-becf-8966bc6e4f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3ad48b9c634996ae4f1f7fc08d95b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:14:15Z,use_quota=True,user_id='93e756be11ee40ccb07df26dd4cd92e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167d58db-1743-4069-ac6d-480e48a69a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167d58db-1743-4069-ac6d-480e48a69a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199daeea-7c7e-4d8b-ac8b-ec35a7c81382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199daeea-7c7e-4d8b-ac8b-ec35a7c81382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf6113b-a3fb-47b0-becf-8966bc6e4f04', 'volume_name': 'volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4080686-db5b-4e74-80fd-a4a0f4ab697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4080686-db5b-4e74-80fd-a4a0f4ab697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20d3f77-3c72-4019-a76d-8d7349ed7cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:14 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Volume ecf6113b-a3fb-47b0-becf-8966bc6e4f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04', 'volume_size': 1} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-440771182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf6113b-a3fb-47b0-becf-8966bc6e4f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3ad48b9c634996ae4f1f7fc08d95b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:14:15Z,use_quota=True,user_id='93e756be11ee40ccb07df26dd4cd92e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Creating volume ecf6113b-a3fb-47b0-becf-8966bc6e4f04 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:14:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:14:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:14:15 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:14:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-f561e863-fabc-458f-b066-1be00f7b3a1e-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:15 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 1073741824 Jul 08 18:14:15 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:15 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74bd5e4-8674-4225-8bc2-ca857fbdecc8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:15 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e Jul 08 18:14:15 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:16 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 1073741824" returned: 0 in 1.100s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:16 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e" returned: 0 in 1.038s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:16 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 Jul 08 18:14:16 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:16 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e Jul 08 18:14:16 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:17 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04" returned: 0 in 0.958s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:14:17 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f561e863-fabc-458f-b066-1be00f7b3a1e" returned: 0 in 1.006s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-quobyte-f561e863-fabc-458f-b066-1be00f7b3a1e" released by "delete_volume" :: held 2.119s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20d3f77-3c72-4019-a76d-8d7349ed7cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ce184a-1d39-4d7a-bc42-e3ef043abd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Created reservations ['b5e90f12-538f-4dfb-983a-95dec768d332', '9fb959ed-585a-46e7-a976-4135f6ee9a73', '8502246c-4ca9-4aad-b2d5-59c651dde4d1', 'a71db0d9-53dd-4256-80f9-2f22d4454b75'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:14:17 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Volume volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 (ecf6113b-a3fb-47b0-becf-8966bc6e4f04): created successfully Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ce184a-1d39-4d7a-bc42-e3ef043abd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Flow 'volume_create_manager' (14135007-7531-4f6e-8127-7c24e5123ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:14:17 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3b12ecbb-ad86-45d1-a0d5-17d3aa83c9d1 tempest-ServerActionsTestOtherA-235294322 None] Created volume successfully. Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:14:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:17 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:14:17 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:18 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.795s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:18 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:14:18 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Deleted volume successfully. Jul 08 18:14:18 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1bcff7a5-0992-403e-a06a-d04dbf8a2443 tempest-SnapshotsActionsTest-808160107 None] Lock "cinder-f561e863-fabc-458f-b066-1be00f7b3a1e-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:27 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:INSERT=5,cinder:UPDATE=25,cinder:SELECT=26,cinder:DELETE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:14:28 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:INSERT=9,cinder:UPDATE=26,cinder:SELECT=12,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Flow 'volume_create_manager' (0116dd86-bb12-4adb-9e11-304930d33543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80feca70-6e6e-488b-bf5a-fd0acca50b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80feca70-6e6e-488b-bf5a-fd0acca50b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2135886310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687795f5-38a8-49ce-ac6c-94a1afd77e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f6790bd76425ca61d92c127b15892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:14:33Z,use_quota=True,user_id='ff2cc448fe8947fd83c28619fd088a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bf554b-7756-4be1-a674-948d607aac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bf554b-7756-4be1-a674-948d607aac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd21968b-c295-46d0-af5c-51a4e149de33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd21968b-c295-46d0-af5c-51a4e149de33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '687795f5-38a8-49ce-ac6c-94a1afd77e02', 'volume_name': 'volume-687795f5-38a8-49ce-ac6c-94a1afd77e02', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2733d4-c06f-47f5-8ca8-8743150ae4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2733d4-c06f-47f5-8ca8-8743150ae4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d3389c-f139-482f-9227-e20fa6733d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:33 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Volume 687795f5-38a8-49ce-ac6c-94a1afd77e02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-687795f5-38a8-49ce-ac6c-94a1afd77e02', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:14:33 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Trying to clone 687795f5-38a8-49ce-ac6c-94a1afd77e02 from image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:14:34 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:14:34 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:14:34 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a85fa4-3e1f-4bfc-a9d2-c44d1d66ba6a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:34 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD Jul 08 18:14:34 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:35 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD" returned: 0 in 1.134s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:35 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Temporary image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 is fetched for user ff2cc448fe8947fd83c28619fd088a13. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:14:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d15cc53-f16e-4d70-841c-d350b7ab990b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:35 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD Jul 08 18:14:35 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:37 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD" returned: 0 in 1.670s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2135886310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687795f5-38a8-49ce-ac6c-94a1afd77e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f6790bd76425ca61d92c127b15892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:14:33Z,use_quota=True,user_id='ff2cc448fe8947fd83c28619fd088a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Creating volume 687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:14:37 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:14:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:37 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 1073741824 Jul 08 18:14:37 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:38 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 1073741824" returned: 0 in 1.656s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:39 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 Jul 08 18:14:39 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:40 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02" returned: 0 in 1.192s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] <== create_volume: return (2954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:14:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.970s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:14:40 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Attempting download of 2c4a33de-7646-4da0-8ea3-4caf9de5a137 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}])) to volume 687795f5-38a8-49ce-ac6c-94a1afd77e02. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:14:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30d57f2-6410-4d32-91a3-e51e31a16c17]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_k58yx6_p {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:40 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_k58yx6_p Jul 08 18:14:40 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:41 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_k58yx6_p" returned: 0 in 1.189s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_k58yx6_p {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:41 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_k58yx6_p Jul 08 18:14:41 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:42 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_k58yx6_p" returned: 1 in 1.411s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_k58yx6_p' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:14:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbc5bb4-8d58-4b1f-bb39-bb4a616221d3]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:43 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD Jul 08 18:14:43 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:44 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD" returned: 0 in 1.703s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:44 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] 2c4a33de-7646-4da0-8ea3-4caf9de5a137 was qcow2, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:14:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:44 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 Jul 08 18:14:44 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:47 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02" returned: 0 in 3.232s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:47 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_69rm81x8devstack@QuobyteHD, size 112.00 MB, duration 3.23 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:14:47 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Converted 112.00 MB image at 34.64 MB/s Jul 08 18:14:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:48 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 1G Jul 08 18:14:48 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:49 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 1G" returned: 0 in 1.123s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a5509-cdf6-4a42-abb2-d58e105d9d19]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:49 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 Jul 08 18:14:49 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:50 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02" returned: 0 in 0.928s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:50 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 Jul 08 18:14:50 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:51 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02" returned: 1 in 1.005s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Downloaded image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}])) to volume 687795f5-38a8-49ce-ac6c-94a1afd77e02 successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Temporary image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 for user ff2cc448fe8947fd83c28619fd088a13 is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Marking volume 687795f5-38a8-49ce-ac6c-94a1afd77e02 as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Copying metadata from image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 to 687795f5-38a8-49ce-ac6c-94a1afd77e02. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Creating volume glance metadata for volume 687795f5-38a8-49ce-ac6c-94a1afd77e02 backed by image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d3389c-f139-482f-9227-e20fa6733d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687795f5-38a8-49ce-ac6c-94a1afd77e02', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ad8c7c-b0b8-4ad0-9900-adc8a27ee102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:14:51 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Volume volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 (687795f5-38a8-49ce-ac6c-94a1afd77e02): created successfully Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ad8c7c-b0b8-4ad0-9900-adc8a27ee102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:14:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Flow 'volume_create_manager' (0116dd86-bb12-4adb-9e11-304930d33543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:14:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-018358a2-47a6-4627-a78e-e7406d97fee8 tempest-VolumesImageMetadata-1556517464 None] Created volume successfully. Jul 08 18:14:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Acquiring lock "cinder-687795f5-38a8-49ce-ac6c-94a1afd77e02-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Lock "cinder-687795f5-38a8-49ce-ac6c-94a1afd77e02-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Acquiring lock "cinder-quobyte-687795f5-38a8-49ce-ac6c-94a1afd77e02" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:14:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Lock "cinder-quobyte-687795f5-38a8-49ce-ac6c-94a1afd77e02" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:14:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ef5e31-c544-4bcb-a293-bada0b91b214]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:14:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:52 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 Jul 08 18:14:52 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:53 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02" returned: 0 in 0.762s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:53 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 Jul 08 18:14:53 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:54 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02" returned: 1 in 0.741s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:14:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:54 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02 Jul 08 18:14:54 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:55 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-687795f5-38a8-49ce-ac6c-94a1afd77e02" returned: 0 in 0.831s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Lock "cinder-quobyte-687795f5-38a8-49ce-ac6c-94a1afd77e02" released by "delete_volume" :: held 2.428s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Created reservations ['2b7df17d-fa34-479d-9ac9-188edab49b5c', 'e31252ee-07b5-44dc-bd9a-90e53d0b650b', '1a993bb7-479f-4217-bdef-6ed7ee36cc01', '0dac1366-80ad-40ea-8acd-963e5e974fbf'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:14:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:14:55 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:14:55 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:14:56 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Jul 08 18:14:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.518s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:14:56 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:14:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Deleted volume successfully. Jul 08 18:14:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-417a16a6-db37-4de0-a4a9-01a9098491cb tempest-VolumesImageMetadata-1556517464 None] Lock "cinder-687795f5-38a8-49ce-ac6c-94a1afd77e02-delete_volume" released by "delete_volume" :: held 4.338s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Flow 'volume_create_manager' (a60d811c-7195-43e3-a781-e1076836e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e99cbce-d74c-4199-9a3f-37174fe833a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e99cbce-d74c-4199-9a3f-37174fe833a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-622238142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e7656d-7fd0-4136-b98b-82993345f934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f211c397024e49d79342286e05e1110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:00Z,use_quota=True,user_id='36be9ffbaa2e4b2f998ccc068732e2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a9713c-a0bc-4861-b248-f947f8285de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a9713c-a0bc-4861-b248-f947f8285de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccf4e39-41ee-4123-a097-cf53b5519158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccf4e39-41ee-4123-a097-cf53b5519158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e7656d-7fd0-4136-b98b-82993345f934', 'volume_name': 'volume-24e7656d-7fd0-4136-b98b-82993345f934', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97bedb4-3895-40a2-ad06-cc23b8f0d4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97bedb4-3895-40a2-ad06-cc23b8f0d4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67ac959-9645-48ff-89cf-901f29a45c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:00 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Volume 24e7656d-7fd0-4136-b98b-82993345f934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e7656d-7fd0-4136-b98b-82993345f934', 'volume_size': 1} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-622238142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e7656d-7fd0-4136-b98b-82993345f934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f211c397024e49d79342286e05e1110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:00Z,use_quota=True,user_id='36be9ffbaa2e4b2f998ccc068732e2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Creating volume 24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:15:00 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:15:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:00 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 1073741824 Jul 08 18:15:00 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:01 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 1073741824" returned: 0 in 0.962s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:01 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 Jul 08 18:15:01 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:02 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:15:02 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:02 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934" returned: 0 in 0.889s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67ac959-9645-48ff-89cf-901f29a45c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e7656d-7fd0-4136-b98b-82993345f934', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea26611-4dc8-45d6-8041-7b0f41ea9d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:02 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Volume volume-24e7656d-7fd0-4136-b98b-82993345f934 (24e7656d-7fd0-4136-b98b-82993345f934): created successfully Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea26611-4dc8-45d6-8041-7b0f41ea9d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Flow 'volume_create_manager' (a60d811c-7195-43e3-a781-e1076836e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:02 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9df2987a-78ad-4214-b6f6-33d44392b8c7 tempest-VolumesDeleteCascade-1650142190 None] Created volume successfully. Jul 08 18:15:03 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.776s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Creating offline snapshot 221fe5d4-1884-4c71-a50c-ecd6c80f3230 of volume 24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a2730f-5a3a-43de-9516-74db9120d0e1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:04 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 Jul 08 18:15:04 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-b7d5c1ac-e425-44e6-a313-4fa1fc30d272 req-b789d5a6-e079-4f4c-bbca-f879667c990b tempest-ServerActionsTestOtherA-235294322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:04 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934" returned: 0 in 0.889s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:04 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 1G Jul 08 18:15:04 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:05 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 1G" returned: 0 in 0.960s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:05 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 Jul 08 18:15:05 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:06 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230" returned: 0 in 0.896s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:06 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 is being set with open permissions: ugo+rw Jul 08 18:15:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:06 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 Jul 08 18:15:06 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Flow 'volume_create_manager' (fea78df1-3cb3-4fbb-b17f-f9085b6369f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70755d76-aafb-4fe0-ab17-c86bddf67db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70755d76-aafb-4fe0-ab17-c86bddf67db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-475901756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9189786db4b4587a5e2b670f58f30ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:07Z,use_quota=True,user_id='1affce42bb9a4a97b30ac94cc371d699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bed0f1d-9579-4093-89d1-314ae3baa909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bed0f1d-9579-4093-89d1-314ae3baa909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b814f2-6e09-4b05-bdd4-13f4913026d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b814f2-6e09-4b05-bdd4-13f4913026d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f', 'volume_name': 'volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c82cbc-6ebf-4f54-be37-6e72e3f1cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c82cbc-6ebf-4f54-be37-6e72e3f1cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4aff91a-7c15-4708-8ce8-b7378c472c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:07 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Volume eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f', 'volume_size': 1} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:07 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230" returned: 0 in 0.998s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:07 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.info Jul 08 18:15:07 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:08 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.info" returned: 0 in 0.751s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:08 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.info is being set with open permissions: ugo+rw Jul 08 18:15:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:08 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.info Jul 08 18:15:08 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:09 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.info" returned: 0 in 0.850s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.447s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-b7d5c1ac-e425-44e6-a313-4fa1fc30d272 req-b789d5a6-e079-4f4c-bbca-f879667c990b tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.072s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[057b0d35-b92c-4f66-bcaa-be672187691e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-b7d5c1ac-e425-44e6-a313-4fa1fc30d272 req-b789d5a6-e079-4f4c-bbca-f879667c990b tempest-ServerActionsTestOtherA-235294322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-34efaeee-a5eb-49df-8e79-b81f4d27b6b0 tempest-VolumesDeleteCascade-1650142190 None] Create snapshot completed successfully Jul 08 18:15:09 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 Jul 08 18:15:09 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:10 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-b7d5c1ac-e425-44e6-a313-4fa1fc30d272 req-b789d5a6-e079-4f4c-bbca-f879667c990b tempest-ServerActionsTestOtherA-235294322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04" returned: 0 in 0.862s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-b7d5c1ac-e425-44e6-a313-4fa1fc30d272 req-b789d5a6-e079-4f4c-bbca-f879667c990b tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.892s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.899s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-475901756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9189786db4b4587a5e2b670f58f30ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:07Z,use_quota=True,user_id='1affce42bb9a4a97b30ac94cc371d699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Creating volume eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:15:10 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:10 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f 1073741824 Jul 08 18:15:10 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-b7d5c1ac-e425-44e6-a313-4fa1fc30d272 req-b789d5a6-e079-4f4c-bbca-f879667c990b tempest-ServerActionsTestOtherA-235294322 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9f0c82b-1aba-4ec3-a306-eb6e82024cc9', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:15:10 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-b7d5c1ac-e425-44e6-a313-4fa1fc30d272 req-b789d5a6-e079-4f4c-bbca-f879667c990b tempest-ServerActionsTestOtherA-235294322 None] attachment_update completed successfully. Jul 08 18:15:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:11 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f 1073741824" returned: 0 in 0.978s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:11 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f Jul 08 18:15:11 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:11 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f" returned: 0 in 0.689s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:15:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.437s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Creating offline snapshot 44c5af9a-1f90-444b-a98e-31a53d354177 of volume 24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4aff91a-7c15-4708-8ce8-b7378c472c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0472bffd-bcfd-4a67-95aa-ed2ae23be818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1884145-a5c4-46f2-9051-c53450082619]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Volume volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f (eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f): created successfully Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0472bffd-bcfd-4a67-95aa-ed2ae23be818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Flow 'volume_create_manager' (fea78df1-3cb3-4fbb-b17f-f9085b6369f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-78315597-de57-44f4-9367-bebe29b8a1c4 tempest-AttachVolumeShelveTestJSON-444184322 None] Created volume successfully. Jul 08 18:15:12 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 Jul 08 18:15:12 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:12 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230" returned: 0 in 0.848s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e7656d-7fd0-4136-b98b-82993345f934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:15:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:12 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 1G Jul 08 18:15:12 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:13 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 1G" returned: 0 in 0.954s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:13 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 Jul 08 18:15:13 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:14 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177" returned: 0 in 0.729s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:14 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 is being set with open permissions: ugo+rw Jul 08 18:15:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:14 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 Jul 08 18:15:14 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Flow 'volume_create_manager' (941f9c67-317c-4737-b945-a2305d1711ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ad8a1d-7408-44df-a846-6c685cce7732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ad8a1d-7408-44df-a846-6c685cce7732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-755068189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1031ce30-e64f-4ced-9157-1fe05b055837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f648b38048e1acde15d75ab225a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:15Z,use_quota=True,user_id='2d47232808fd4cae9dc838442733887d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e66c44-bf40-4b32-b88a-8fe0109b5e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e66c44-bf40-4b32-b88a-8fe0109b5e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4251744a-bd57-46a8-929b-2929298e5cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4251744a-bd57-46a8-929b-2929298e5cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1031ce30-e64f-4ced-9157-1fe05b055837', 'volume_name': 'volume-1031ce30-e64f-4ced-9157-1fe05b055837', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065f9457-1ef7-4e1a-bde7-c614647f0cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065f9457-1ef7-4e1a-bde7-c614647f0cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95451d96-b083-4d63-801a-b2727ad3cf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:15 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Volume 1031ce30-e64f-4ced-9157-1fe05b055837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1031ce30-e64f-4ced-9157-1fe05b055837', 'volume_size': 1} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:15 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177" returned: 0 in 0.800s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.436s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-755068189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1031ce30-e64f-4ced-9157-1fe05b055837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f648b38048e1acde15d75ab225a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:15Z,use_quota=True,user_id='2d47232808fd4cae9dc838442733887d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Creating volume 1031ce30-e64f-4ced-9157-1fe05b055837 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:15:15 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:15 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 1073741824 Jul 08 18:15:15 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-755637f2-f6ab-4fbc-abe3-2fb0261eb43a tempest-VolumesDeleteCascade-1650142190 None] Create snapshot completed successfully Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-24e7656d-7fd0-4136-b98b-82993345f934-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-24e7656d-7fd0-4136-b98b-82993345f934-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Performing cascade delete. {{(pid=87309) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-221fe5d4-1884-4c71-a50c-ecd6c80f3230-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-221fe5d4-1884-4c71-a50c-ecd6c80f3230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-221fe5d4-1884-4c71-a50c-ecd6c80f3230" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-221fe5d4-1884-4c71-a50c-ecd6c80f3230" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Deleting offline snapshot 221fe5d4-1884-4c71-a50c-ecd6c80f3230 of volume 24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] snapshot_file for this snap is: volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[974aa3b0-90b9-4d35-bfb6-6143ec2ffd93]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:16 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 Jul 08 18:15:16 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:16 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 1073741824" returned: 0 in 1.048s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:16 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 Jul 08 18:15:16 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:16 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230" returned: 0 in 0.913s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e7656d-7fd0-4136-b98b-82993345f934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:15:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e36e90-8871-4417-acfe-00417fd5cedc]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:17 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 Jul 08 18:15:17 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:17 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837" returned: 0 in 0.687s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95451d96-b083-4d63-801a-b2727ad3cf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1031ce30-e64f-4ced-9157-1fe05b055837', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3200ed58-eccb-441e-8391-da8ad5424771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:17 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Volume volume-1031ce30-e64f-4ced-9157-1fe05b055837 (1031ce30-e64f-4ced-9157-1fe05b055837): created successfully Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3200ed58-eccb-441e-8391-da8ad5424771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Flow 'volume_create_manager' (941f9c67-317c-4737-b945-a2305d1711ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:17 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-551b6e59-b76e-4c4e-816e-62030c4a55bd tempest-ServersNegativeTestJSON-1408680719 None] Created volume successfully. Jul 08 18:15:17 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934" returned: 0 in 0.877s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[695eaf45-fbee-42f0-aeab-d80422f5dc1e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:18 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 Jul 08 18:15:18 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:18 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-8d162875-863e-4b76-a4d6-61dd5db1b798 tempest-ServerActionsTestOtherA-235294322 None] Terminate volume connection completed successfully. Jul 08 18:15:18 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-8d162875-863e-4b76-a4d6-61dd5db1b798 tempest-ServerActionsTestOtherA-235294322 None] Deleting attachment c9f0c82b-1aba-4ec3-a306-eb6e82024cc9. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:15:18 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177" returned: 0 in 0.922s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e7656d-7fd0-4136-b98b-82993345f934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:15:18 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f18a7d-3f33-49bd-ae11-60fa6a68bcea]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:19 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 Jul 08 18:15:19 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:19 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230" returned: 0 in 0.991s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e7656d-7fd0-4136-b98b-82993345f934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:15:19 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bfa990-d8cf-4ec1-b85f-754f86ed3094]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:15:20 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 Jul 08 18:15:20 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Flow 'volume_create_manager' (514f31c1-5a3a-4270-bdfb-f295b2517480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bb3613-5341-4fdf-a29a-d88a0c859804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bb3613-5341-4fdf-a29a-d88a0c859804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1990922051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11bb2efb-b846-4485-85b3-b4188301edbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f648b38048e1acde15d75ab225a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:20Z,use_quota=True,user_id='2d47232808fd4cae9dc838442733887d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf2c5c7-5e7c-4a55-a1ba-fb12fee6f5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf2c5c7-5e7c-4a55-a1ba-fb12fee6f5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d590642-4d5d-48f2-95e2-668727cefeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d590642-4d5d-48f2-95e2-668727cefeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11bb2efb-b846-4485-85b3-b4188301edbc', 'volume_name': 'volume-11bb2efb-b846-4485-85b3-b4188301edbc', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd217c5-04e9-435c-9ef8-bc524b9b5857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd217c5-04e9-435c-9ef8-bc524b9b5857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c676486-9b24-4ec5-9721-3231f5e037df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:20 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Volume 11bb2efb-b846-4485-85b3-b4188301edbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11bb2efb-b846-4485-85b3-b4188301edbc', 'volume_size': 1} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1990922051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11bb2efb-b846-4485-85b3-b4188301edbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b2f648b38048e1acde15d75ab225a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:20Z,use_quota=True,user_id='2d47232808fd4cae9dc838442733887d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Creating volume 11bb2efb-b846-4485-85b3-b4188301edbc {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:15:20 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:20 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc 1073741824 Jul 08 18:15:20 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:20 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934" returned: 0 in 1.034s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:20 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 Jul 08 18:15:20 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-a4de1f26-a39d-4066-bef2-91c263fb9d56 tempest-ServerActionsTestOtherA-235294322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:21 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc 1073741824" returned: 0 in 1.130s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:21 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc Jul 08 18:15:21 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:21 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230" returned: 0 in 0.982s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:21 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230 Jul 08 18:15:21 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:22 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc" returned: 0 in 0.810s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-a4de1f26-a39d-4066-bef2-91c263fb9d56 tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.932s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c676486-9b24-4ec5-9721-3231f5e037df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11bb2efb-b846-4485-85b3-b4188301edbc', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568cf200-675d-4375-a656-ff1423b02139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2779045d-e2ab-4abc-87d1-dc421827819d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-a4de1f26-a39d-4066-bef2-91c263fb9d56 tempest-ServerActionsTestOtherA-235294322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:22 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Volume volume-11bb2efb-b846-4485-85b3-b4188301edbc (11bb2efb-b846-4485-85b3-b4188301edbc): created successfully Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568cf200-675d-4375-a656-ff1423b02139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Flow 'volume_create_manager' (514f31c1-5a3a-4270-bdfb-f295b2517480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:22 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0c62e88d-524b-4a59-8e8f-de051951adcb tempest-ServersNegativeTestJSON-1408680719 None] Created volume successfully. Jul 08 18:15:22 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 Jul 08 18:15:22 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:22 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.221fe5d4-1884-4c71-a50c-ecd6c80f3230" returned: 0 in 0.696s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 -F qcow2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:22 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 -F qcow2 Jul 08 18:15:22 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:23 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-a4de1f26-a39d-4066-bef2-91c263fb9d56 tempest-ServerActionsTestOtherA-235294322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04" returned: 0 in 0.832s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-a4de1f26-a39d-4066-bef2-91c263fb9d56 tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-a4de1f26-a39d-4066-bef2-91c263fb9d56 tempest-ServerActionsTestOtherA-235294322 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b818f18d-1c34-46cb-bf9d-ad0f79fae1e2', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:15:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-2a22ab3f-9752-49ee-9d77-af3ce28864f4 req-a4de1f26-a39d-4066-bef2-91c263fb9d56 tempest-ServerActionsTestOtherA-235294322 None] attachment_update completed successfully. Jul 08 18:15:23 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e7656d-7fd0-4136-b98b-82993345f934 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 -F qcow2" returned: 0 in 0.826s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-221fe5d4-1884-4c71-a50c-ecd6c80f3230" released by "_delete_snapshot" :: held 7.515s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" released by "delete_snapshot" :: held 7.547s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "cinder-11bb2efb-b846-4485-85b3-b4188301edbc-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Lock "cinder-11bb2efb-b846-4485-85b3-b4188301edbc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Created reservations ['6afa2961-327f-49d7-93b7-d82869424872', '95f9588b-68f5-4548-9016-d9dd45bfe7b7', '2df20943-8dcf-41f2-b16f-1d254502c525', 'f4b84098-bb5a-47b9-aa30-2a518baf69e7'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "cinder-quobyte-11bb2efb-b846-4485-85b3-b4188301edbc" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Lock "cinder-quobyte-11bb2efb-b846-4485-85b3-b4188301edbc" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[554910e7-e5bb-436c-a94c-343c24a1b824]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Delete snapshot completed successfully. Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-221fe5d4-1884-4c71-a50c-ecd6c80f3230-delete_snapshot" released by "delete_snapshot" :: held 7.806s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-44c5af9a-1f90-444b-a98e-31a53d354177-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-44c5af9a-1f90-444b-a98e-31a53d354177-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-44c5af9a-1f90-444b-a98e-31a53d354177" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-44c5af9a-1f90-444b-a98e-31a53d354177" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:23 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc Jul 08 18:15:23 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Deleting offline snapshot 44c5af9a-1f90-444b-a98e-31a53d354177 of volume 24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] snapshot_file for this snap is: volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f727d-4d31-40a2-85b8-21d4eef24767]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:23 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 Jul 08 18:15:23 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:24 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc" returned: 0 in 0.971s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:24 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc Jul 08 18:15:24 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:24 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177" returned: 0 in 0.928s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e7656d-7fd0-4136-b98b-82993345f934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:15:24 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25059e7-b3b7-4443-94f8-7f93ef7369c7]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:24 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 Jul 08 18:15:24 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:25 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-11bb2efb-b846-4485-85b3-b4188301edbc" returned: 0 in 0.741s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Lock "cinder-quobyte-11bb2efb-b846-4485-85b3-b4188301edbc" released by "delete_volume" :: held 1.770s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Created reservations ['fcbc3790-6d68-424b-a0f3-1c5fb54620ad', 'c88d3375-bd7c-4148-bdbe-9a43a08413bc', '91e15ba1-23a5-4b9f-847c-a5a578e3e163', 'fca831b5-0e43-486e-a2a5-522e4f972321'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:25 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:15:25 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "cinder-1031ce30-e64f-4ced-9157-1fe05b055837-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Lock "cinder-1031ce30-e64f-4ced-9157-1fe05b055837-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:25 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934" returned: 0 in 1.098s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "cinder-quobyte-1031ce30-e64f-4ced-9157-1fe05b055837" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Lock "cinder-quobyte-1031ce30-e64f-4ced-9157-1fe05b055837" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:25 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 Jul 08 18:15:25 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98fbac8-7fd3-49f8-a0a5-ed24905d9391]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:26 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 Jul 08 18:15:26 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:26 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.957s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:26 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:15:26 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Deleted volume successfully. Jul 08 18:15:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-54f645e0-bf7a-48d8-9330-8f75e175beff tempest-ServersNegativeTestJSON-1408680719 None] Lock "cinder-11bb2efb-b846-4485-85b3-b4188301edbc-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:26 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177" returned: 0 in 1.074s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:26 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177 Jul 08 18:15:26 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:27 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837" returned: 0 in 1.086s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:27 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837 Jul 08 18:15:27 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:28 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934.44c5af9a-1f90-444b-a98e-31a53d354177" returned: 0 in 1.175s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-44c5af9a-1f90-444b-a98e-31a53d354177" released by "_delete_snapshot" :: held 4.421s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" released by "delete_snapshot" :: held 4.449s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=45,cinder:SELECT=53,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=58,cinder:UPDATE=45,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:15:28 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1031ce30-e64f-4ced-9157-1fe05b055837" returned: 0 in 1.266s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Lock "cinder-quobyte-1031ce30-e64f-4ced-9157-1fe05b055837" released by "delete_volume" :: held 2.431s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Created reservations ['a1ce20f9-a5d3-40eb-8bc5-6cf1cbf867ec', '446b6ddd-ae07-4b5f-9a09-3103f3c23745', 'b7100476-b69b-4025-bd92-b7dbd4107ed4', '733fbd16-7c26-456e-b7da-117f3edcf87e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Created reservations ['1b9ceae8-1863-472a-a22c-2b31c585f279', '23e89e8b-a2cc-4954-90c3-e4e0e94962ca', '0978e577-60e7-4956-a767-eca8a7c636cb', 'fbe37006-b9cc-4339-bc25-2f20516f824e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:15:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Delete snapshot completed successfully. Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-44c5af9a-1f90-444b-a98e-31a53d354177-delete_snapshot" released by "delete_snapshot" :: held 4.832s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Snapshots deleted, issuing volume delete {{(pid=87309) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[109a7b95-bb23-4bc2-872f-7836bf4f451d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:28 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:15:28 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:28 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 Jul 08 18:15:28 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-efbe8e80-39c4-46d5-8659-f29beaa68af9 req-786bb9af-3234-4d6b-a33d-67556c84b24c tempest-AttachVolumeShelveTestJSON-444184322 None] No connector for attachment c3956fa0-0780-4ca2-a9a6-0e83123b8092; skipping storage backend terminate_connection call. {{(pid=87309) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 18:15:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-efbe8e80-39c4-46d5-8659-f29beaa68af9 req-786bb9af-3234-4d6b-a33d-67556c84b24c tempest-AttachVolumeShelveTestJSON-444184322 None] Deleting attachment c3956fa0-0780-4ca2-a9a6-0e83123b8092. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:15:29 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.916s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:29 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:15:29 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Deleted volume successfully. Jul 08 18:15:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-661def7a-dbb4-4071-aa07-ebbbc82d504a tempest-ServersNegativeTestJSON-1408680719 None] Lock "cinder-1031ce30-e64f-4ced-9157-1fe05b055837-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:29 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934" returned: 0 in 1.058s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:29 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934 Jul 08 18:15:29 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:30 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-24e7656d-7fd0-4136-b98b-82993345f934" returned: 0 in 0.734s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-24e7656d-7fd0-4136-b98b-82993345f934" released by "delete_volume" :: held 1.894s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Created reservations ['e8bfb5ae-6fcb-48ff-9f32-6fc51d9b2300', 'c54d80dc-7728-4c6d-ac4c-51a1bcb6e6d6', 'f19a5916-cb9f-44d5-b029-c98f17d4075e', '426c5384-4aba-4592-8cf7-6417dfcf5b5b'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:30 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:15:30 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:31 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.220s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:31 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:15:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Deleted volume successfully. Jul 08 18:15:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3dfb833-083e-4b12-8ddc-093271fea151 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-24e7656d-7fd0-4136-b98b-82993345f934-delete_volume" released by "delete_volume" :: held 16.130s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Flow 'volume_create_manager' (601db791-899f-4f9d-a48c-a8bed187d162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc11c94-4ab8-4b6c-912e-9cf2bd2b3ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc11c94-4ab8-4b6c-912e-9cf2bd2b3ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1089995713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8d5084-aa02-49ac-bd87-03be1cef5510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f211c397024e49d79342286e05e1110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:33Z,use_quota=True,user_id='36be9ffbaa2e4b2f998ccc068732e2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea71148e-b1c6-46de-b42c-04a84e38c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea71148e-b1c6-46de-b42c-04a84e38c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c056a2a-c7db-420c-8dc6-fd5ed8bc8173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c056a2a-c7db-420c-8dc6-fd5ed8bc8173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8d5084-aa02-49ac-bd87-03be1cef5510', 'volume_name': 'volume-2d8d5084-aa02-49ac-bd87-03be1cef5510', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02e23ca-f92c-4aca-a44f-1c4f3fb9af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02e23ca-f92c-4aca-a44f-1c4f3fb9af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ac5a2a-5365-4992-9403-1d9574557c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:32 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Volume 2d8d5084-aa02-49ac-bd87-03be1cef5510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8d5084-aa02-49ac-bd87-03be1cef5510', 'volume_size': 1} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1089995713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8d5084-aa02-49ac-bd87-03be1cef5510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f211c397024e49d79342286e05e1110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:33Z,use_quota=True,user_id='36be9ffbaa2e4b2f998ccc068732e2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Creating volume 2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:15:32 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:15:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:32 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 1073741824 Jul 08 18:15:32 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:34 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 1073741824" returned: 0 in 1.170s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:34 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 Jul 08 18:15:34 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:34 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510" returned: 0 in 0.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ac5a2a-5365-4992-9403-1d9574557c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8d5084-aa02-49ac-bd87-03be1cef5510', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8fe075-e90f-457f-919d-108086c8c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:34 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Volume volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 (2d8d5084-aa02-49ac-bd87-03be1cef5510): created successfully Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8fe075-e90f-457f-919d-108086c8c907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Flow 'volume_create_manager' (601db791-899f-4f9d-a48c-a8bed187d162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:34 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ceb8f523-1cad-45c9-8479-cdbd56ece073 tempest-VolumesDeleteCascade-1650142190 None] Created volume successfully. Jul 08 18:15:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Creating offline snapshot 662b19d2-0511-4aa9-9f26-8eb14d15647d of volume 2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:15:36 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87dd8a-b8da-49f3-8afd-09992fb33b16]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:36 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 Jul 08 18:15:36 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:36 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510" returned: 0 in 0.765s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:37 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d 1G Jul 08 18:15:37 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:37 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d 1G" returned: 0 in 0.845s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:37 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d Jul 08 18:15:37 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:38 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d" returned: 0 in 0.874s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:38 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d is being set with open permissions: ugo+rw Jul 08 18:15:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:38 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d Jul 08 18:15:38 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:39 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d" returned: 0 in 0.803s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:39 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.info Jul 08 18:15:39 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:40 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.info" returned: 0 in 0.767s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:40 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.info is being set with open permissions: ugo+rw Jul 08 18:15:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:40 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.info Jul 08 18:15:40 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:40 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.info" returned: 0 in 0.677s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.823s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:41 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b2aea2a2-18a1-41bc-b7e2-f52b8f4f6966 tempest-VolumesDeleteCascade-1650142190 None] Create snapshot completed successfully Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Flow 'volume_create_manager' (f160a7c2-8675-4d87-a681-3f09894780aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79ee555-12bf-4a2f-915f-1b4713c2993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79ee555-12bf-4a2f-915f-1b4713c2993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1900829178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9309f4-1c49-4a1c-8701-a5042f9f3acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f211c397024e49d79342286e05e1110b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=662b19d2-0511-4aa9-9f26-8eb14d15647d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:15:43Z,use_quota=True,user_id='36be9ffbaa2e4b2f998ccc068732e2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f8baca-94be-46a9-939b-bbe4b798cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f8baca-94be-46a9-939b-bbe4b798cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d61c36f-1935-4196-bc99-3ece076735f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d61c36f-1935-4196-bc99-3ece076735f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a9309f4-1c49-4a1c-8701-a5042f9f3acb', 'volume_name': 'volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb', 'volume_size': 1, 'snapshot_id': '662b19d2-0511-4aa9-9f26-8eb14d15647d'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2badec-7756-4f69-8fb3-3ad5319e0f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2badec-7756-4f69-8fb3-3ad5319e0f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb5257e-59ce-4c2d-9e59-3fbeab59a434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:42 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Volume 7a9309f4-1c49-4a1c-8701-a5042f9f3acb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb', 'volume_size': 1, 'snapshot_id': '662b19d2-0511-4aa9-9f26-8eb14d15647d'} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-662b19d2-0511-4aa9-9f26-8eb14d15647d-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-662b19d2-0511-4aa9-9f26-8eb14d15647d-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Creating volume 7a9309f4-1c49-4a1c-8701-a5042f9f3acb from snapshot 662b19d2-0511-4aa9-9f26-8eb14d15647d {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] snapshot: 662b19d2-0511-4aa9-9f26-8eb14d15647d, volume: 7a9309f4-1c49-4a1c-8701-a5042f9f3acb, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:15:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:15:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:15:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:15:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:15:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef78bce-205b-4da5-827b-a2c4a478d19e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:43 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d Jul 08 18:15:43 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:44 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d" returned: 0 in 1.103s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d8d5084-aa02-49ac-bd87-03be1cef5510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:15:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:15:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:15:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3105b56-0f25-4219-b72d-9a9ee0dc73ac]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:44 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 Jul 08 18:15:44 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:45 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510" returned: 0 in 0.982s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:45 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:15:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:45 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb Jul 08 18:15:45 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:51 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" returned: 0 in 6.705s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7978ce5b-00e4-4abc-bdf4-3ddc72c169f3]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:52 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 Jul 08 18:15:52 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:52 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:15:52 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=19,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:15:53 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510" returned: 0 in 1.845s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:53 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:15:53 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Converted 1024.00 MB image at 152.70 MB/s Jul 08 18:15:53 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb is being set with open permissions: ugo+rw Jul 08 18:15:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:53 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb Jul 08 18:15:53 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:54 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" returned: 0 in 0.962s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" released by "_copy_volume_from_snapshot" :: held 11.773s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-662b19d2-0511-4aa9-9f26-8eb14d15647d-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" released by "_create_volume_from_snapshot" :: held 11.842s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:15:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.867s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:15:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb5257e-59ce-4c2d-9e59-3fbeab59a434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb', 'volume_size': 1, 'snapshot_id': '662b19d2-0511-4aa9-9f26-8eb14d15647d'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a28268-f870-4b70-9c5d-9b2c192db8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:15:54 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Volume volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb (7a9309f4-1c49-4a1c-8701-a5042f9f3acb): created successfully Jul 08 18:15:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a28268-f870-4b70-9c5d-9b2c192db8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:15:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Flow 'volume_create_manager' (f160a7c2-8675-4d87-a681-3f09894780aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:15:54 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e2500dcc-95c9-4838-973b-0e91b0f4dd76 tempest-VolumesDeleteCascade-1650142190 None] Created volume successfully. Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-2d8d5084-aa02-49ac-bd87-03be1cef5510-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-2d8d5084-aa02-49ac-bd87-03be1cef5510-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Performing cascade delete. {{(pid=87309) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-662b19d2-0511-4aa9-9f26-8eb14d15647d-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-662b19d2-0511-4aa9-9f26-8eb14d15647d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-2d8d5084-aa02-49ac-bd87-03be1cef5510" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-2d8d5084-aa02-49ac-bd87-03be1cef5510" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-662b19d2-0511-4aa9-9f26-8eb14d15647d" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-662b19d2-0511-4aa9-9f26-8eb14d15647d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Deleting offline snapshot 662b19d2-0511-4aa9-9f26-8eb14d15647d of volume 2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] snapshot_file for this snap is: volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[31266661-e0aa-4bca-9ba1-e60b3cd9768a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:55 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d Jul 08 18:15:55 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:56 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d" returned: 0 in 1.133s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d8d5084-aa02-49ac-bd87-03be1cef5510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:15:56 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2470aba3-f938-4761-a5f6-2b8c237f0752]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:15:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:56 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 Jul 08 18:15:56 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:57 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-0d8df412-e1cd-4aca-9d12-22579446ce43 req-b8b38eb2-574f-41d8-b48f-4587337cc643 tempest-ServerActionsTestOtherA-235294322 None] Terminate volume connection completed successfully. Jul 08 18:15:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-0d8df412-e1cd-4aca-9d12-22579446ce43 req-b8b38eb2-574f-41d8-b48f-4587337cc643 tempest-ServerActionsTestOtherA-235294322 None] Deleting attachment b818f18d-1c34-46cb-bf9d-ad0f79fae1e2. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:15:57 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510" returned: 0 in 0.935s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:57 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d Jul 08 18:15:57 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:15:59 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jul 08 18:15:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d" returned: 0 in 1.470s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:15:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:15:59 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d Jul 08 18:15:59 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:00 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510.662b19d2-0511-4aa9-9f26-8eb14d15647d" returned: 0 in 0.997s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-662b19d2-0511-4aa9-9f26-8eb14d15647d" released by "_delete_snapshot" :: held 4.675s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-2d8d5084-aa02-49ac-bd87-03be1cef5510" released by "delete_snapshot" :: held 4.719s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Created reservations ['fec5ab12-6daa-4a43-87d3-47344af6550f', '5077a7b0-445b-4a56-ac31-63b077efd657', '7c1957b2-f227-4562-8c69-c6ba4abc65fe', 'a5c4a6e4-d527-4cd7-a848-b367040f1b66'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:16:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Delete snapshot completed successfully. Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-662b19d2-0511-4aa9-9f26-8eb14d15647d-delete_snapshot" released by "delete_snapshot" :: held 4.900s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Snapshots deleted, issuing volume delete {{(pid=87309) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-2d8d5084-aa02-49ac-bd87-03be1cef5510" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-2d8d5084-aa02-49ac-bd87-03be1cef5510" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71cbce8-1ba6-4dfc-a0f5-ad39191fbe43]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:16:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:00 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 Jul 08 18:16:00 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:01 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510" returned: 0 in 0.975s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:01 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510 Jul 08 18:16:01 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:02 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:16:02 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:02 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2d8d5084-aa02-49ac-bd87-03be1cef5510" returned: 0 in 1.426s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-2d8d5084-aa02-49ac-bd87-03be1cef5510" released by "delete_volume" :: held 2.486s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:02 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Created reservations ['d06b38d9-e0fb-4d66-9c52-8c06f8f434a6', '9b58625f-822a-4157-b7a1-ab634a0e5558', '48d0db88-aa68-440f-9131-36fbdde6bb99', '4ff9ac8f-de6e-4fe2-a64a-1eb335c03130'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:03 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:16:03 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-7a9309f4-1c49-4a1c-8701-a5042f9f3acb-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-7a9309f4-1c49-4a1c-8701-a5042f9f3acb-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "cinder-quobyte-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0591accf-4b0a-40ef-9376-599b42bc9f1c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:03 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.459s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:16:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:16:04 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb Jul 08 18:16:04 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:04 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.467s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:04 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:16:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Deleted volume successfully. Jul 08 18:16:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-844d3bba-3cec-41dc-80b4-e66cea1ddc63 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-2d8d5084-aa02-49ac-bd87-03be1cef5510-delete_volume" released by "delete_volume" :: held 9.327s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:05 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" returned: 0 in 1.262s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:05 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb Jul 08 18:16:05 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:05 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" returned: 0 in 0.799s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-quobyte-7a9309f4-1c49-4a1c-8701-a5042f9f3acb" released by "delete_volume" :: held 2.154s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:05 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Created reservations ['3aafe518-4d02-4bfd-8791-8b884d8b9e81', '606084ac-9a25-4e5c-bc0d-34ce8882deee', 'a95a33d9-16e5-4221-acd0-1dbb33067530', '912a3ec4-dda6-43e7-9700-9ec40e55d173'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:06 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:16:06 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:06 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.750s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:16:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Deleted volume successfully. Jul 08 18:16:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5206402f-a22e-41ac-929e-9f5d100001c8 tempest-VolumesDeleteCascade-1650142190 None] Lock "cinder-7a9309f4-1c49-4a1c-8701-a5042f9f3acb-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Acquiring lock "cinder-ecf6113b-a3fb-47b0-becf-8966bc6e4f04-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Lock "cinder-ecf6113b-a3fb-47b0-becf-8966bc6e4f04-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Acquiring lock "cinder-quobyte-ecf6113b-a3fb-47b0-becf-8966bc6e4f04" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Lock "cinder-quobyte-ecf6113b-a3fb-47b0-becf-8966bc6e4f04" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec571ee-44f1-4b63-9e48-1cc790962573]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:16:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:09 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 Jul 08 18:16:09 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:10 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04" returned: 0 in 0.847s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:10 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04 Jul 08 18:16:10 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:10 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ecf6113b-a3fb-47b0-becf-8966bc6e4f04" returned: 0 in 0.688s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Lock "cinder-quobyte-ecf6113b-a3fb-47b0-becf-8966bc6e4f04" released by "delete_volume" :: held 1.591s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Created reservations ['ad99b9dc-3722-4068-95b6-aed031369aa2', '9a32e650-11b1-4742-af90-368d8a8d2749', '62bbcd53-bdcb-4866-b693-9a95a0684df3', 'f19ae5e2-6159-4cd0-aa01-bc24206f06b2'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:11 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:16:11 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:11 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.709s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:16:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Deleted volume successfully. Jul 08 18:16:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f1762b5-0e06-4ad9-b320-a631425d0ae8 tempest-ServerActionsTestOtherA-235294322 None] Lock "cinder-ecf6113b-a3fb-47b0-becf-8966bc6e4f04-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Flow 'volume_create_manager' (6b20a1a9-0203-4c14-91f6-6fe562afca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9db53f-6d77-473f-92f0-10405dd9d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9db53f-6d77-473f-92f0-10405dd9d712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1051292279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c53e88-5d60-47df-9a8d-6309c5a3c403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0a427d28384fd68bef6c08c3c6d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:12Z,use_quota=True,user_id='ecfa91477b1a44b5b2696ee21ad8ce29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa09912-04b1-41d3-8683-2b438d2c6d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa09912-04b1-41d3-8683-2b438d2c6d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7566fcc-90ff-41de-a16d-fe9b0cabcf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7566fcc-90ff-41de-a16d-fe9b0cabcf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c53e88-5d60-47df-9a8d-6309c5a3c403', 'volume_name': 'volume-20c53e88-5d60-47df-9a8d-6309c5a3c403', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350b703e-5cdf-406b-b2c8-a02b5a451e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350b703e-5cdf-406b-b2c8-a02b5a451e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53a7333-02f7-48ce-a6d8-caa9d0d07678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Volume 20c53e88-5d60-47df-9a8d-6309c5a3c403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c53e88-5d60-47df-9a8d-6309c5a3c403', 'volume_size': 1} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1051292279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c53e88-5d60-47df-9a8d-6309c5a3c403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0a427d28384fd68bef6c08c3c6d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:12Z,use_quota=True,user_id='ecfa91477b1a44b5b2696ee21ad8ce29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Creating volume 20c53e88-5d60-47df-9a8d-6309c5a3c403 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:16:12 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:16:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:12 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 1073741824 Jul 08 18:16:12 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:13 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 1073741824" returned: 0 in 0.826s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:13 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 Jul 08 18:16:13 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:14 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403" returned: 0 in 0.903s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:16:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53a7333-02f7-48ce-a6d8-caa9d0d07678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c53e88-5d60-47df-9a8d-6309c5a3c403', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cac8894-5aa7-471f-992b-9a19381ebd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:14 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Volume volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 (20c53e88-5d60-47df-9a8d-6309c5a3c403): created successfully Jul 08 18:16:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cac8894-5aa7-471f-992b-9a19381ebd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Flow 'volume_create_manager' (6b20a1a9-0203-4c14-91f6-6fe562afca5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4a3a1523-7187-4cb6-af01-58446c30c5b7 tempest-VolumesTransfersV355Test-782351323 None] Created volume successfully. Jul 08 18:16:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a9602839-77f8-4337-aa10-a48003603bd1 tempest-VolumesTransfersV355Test-1627256523 None] Transfer volume completed successfully. Jul 08 18:16:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Acquiring lock "cinder-20c53e88-5d60-47df-9a8d-6309c5a3c403-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Lock "cinder-20c53e88-5d60-47df-9a8d-6309c5a3c403-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Acquiring lock "cinder-quobyte-20c53e88-5d60-47df-9a8d-6309c5a3c403" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Lock "cinder-quobyte-20c53e88-5d60-47df-9a8d-6309c5a3c403" acquired by "delete_volume" :: waited 0.052s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b8bef0-2c69-4e05-ac69-2773e87f466d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:16:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:16 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 Jul 08 18:16:16 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:17 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403" returned: 0 in 0.892s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:17 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403 Jul 08 18:16:17 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:18 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20c53e88-5d60-47df-9a8d-6309c5a3c403" returned: 0 in 0.914s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Lock "cinder-quobyte-20c53e88-5d60-47df-9a8d-6309c5a3c403" released by "delete_volume" :: held 1.883s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Created reservations ['12afee0a-f907-4f98-9610-fa1b30558697', '3c7c71f6-437a-4f20-b082-f3cb78248ee7', '878259c3-c220-4a1a-addd-07705dab585e', 'b8db2849-c149-4a63-ab0e-e9df269e9d8a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:18 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:16:18 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:19 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.759s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:16:19 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Deleted volume successfully. Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22181b41-c6b3-49db-a6c7-facede902214 tempest-VolumesTransfersV355Test-622016362 None] Lock "cinder-20c53e88-5d60-47df-9a8d-6309c5a3c403-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Flow 'volume_create_manager' (a715b0bc-4ac7-4506-b086-44ddbbf4da85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badb6cf8-8cca-468a-aabd-ccb537a28bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badb6cf8-8cca-468a-aabd-ccb537a28bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1615235610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a166872-dd5c-4e61-acbe-e310123c514c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0a427d28384fd68bef6c08c3c6d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:19Z,use_quota=True,user_id='ecfa91477b1a44b5b2696ee21ad8ce29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152ce90c-5a74-4744-92f5-90a6262aeb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152ce90c-5a74-4744-92f5-90a6262aeb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f26fedc-0586-4db4-a53e-29c7852b2bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f26fedc-0586-4db4-a53e-29c7852b2bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a166872-dd5c-4e61-acbe-e310123c514c', 'volume_name': 'volume-2a166872-dd5c-4e61-acbe-e310123c514c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd2de65-16ca-40e3-9d29-197762cb1f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd2de65-16ca-40e3-9d29-197762cb1f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07856bb2-e576-447f-aa33-e582ac5fcfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:19 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Volume 2a166872-dd5c-4e61-acbe-e310123c514c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a166872-dd5c-4e61-acbe-e310123c514c', 'volume_size': 1} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1615235610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a166872-dd5c-4e61-acbe-e310123c514c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0a427d28384fd68bef6c08c3c6d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:19Z,use_quota=True,user_id='ecfa91477b1a44b5b2696ee21ad8ce29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Creating volume 2a166872-dd5c-4e61-acbe-e310123c514c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:16:19 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:16:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:19 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c 1073741824 Jul 08 18:16:19 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:20 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c 1073741824" returned: 0 in 0.952s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:20 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c Jul 08 18:16:20 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:21 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c" returned: 0 in 0.731s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:16:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07856bb2-e576-447f-aa33-e582ac5fcfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a166872-dd5c-4e61-acbe-e310123c514c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ce7077-88ee-42ef-aa2f-84f47f02f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:21 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Volume volume-2a166872-dd5c-4e61-acbe-e310123c514c (2a166872-dd5c-4e61-acbe-e310123c514c): created successfully Jul 08 18:16:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ce7077-88ee-42ef-aa2f-84f47f02f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Flow 'volume_create_manager' (a715b0bc-4ac7-4506-b086-44ddbbf4da85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:21 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2bf1e475-b854-4260-94b7-8031b853e98d tempest-VolumesTransfersV355Test-782351323 None] Created volume successfully. Jul 08 18:16:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Acquiring lock "cinder-2a166872-dd5c-4e61-acbe-e310123c514c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Lock "cinder-2a166872-dd5c-4e61-acbe-e310123c514c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Acquiring lock "cinder-quobyte-2a166872-dd5c-4e61-acbe-e310123c514c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Lock "cinder-quobyte-2a166872-dd5c-4e61-acbe-e310123c514c" acquired by "delete_volume" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:22 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8192a08f-a813-4174-a5be-62223830a79f]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:16:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:22 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c Jul 08 18:16:22 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:23 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c" returned: 0 in 0.898s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:23 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c Jul 08 18:16:23 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:24 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a166872-dd5c-4e61-acbe-e310123c514c" returned: 0 in 0.813s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Lock "cinder-quobyte-2a166872-dd5c-4e61-acbe-e310123c514c" released by "delete_volume" :: held 1.787s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Created reservations ['2a8f8add-17a7-478b-bebf-38ece9eef1c3', '751fc138-fcef-4776-b9a9-384cb62e3127', '4b1d7376-a6a7-487a-b6e1-46cca5be6605', '9a34ce18-154c-4e93-833a-14b42a14f79c'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:24 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:16:24 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:25 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.116s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:25 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:16:25 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Deleted volume successfully. Jul 08 18:16:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-06b4c029-5396-4ff5-901c-3f385c238d11 tempest-VolumesTransfersV355Test-622016362 None] Lock "cinder-2a166872-dd5c-4e61-acbe-e310123c514c-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Acquiring lock "cinder-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "cinder-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Acquiring lock "cinder-quobyte-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "cinder-quobyte-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:26 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3b0620-bc94-4b1a-bf6f-fc32d8ace6c9]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:16:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:26 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f Jul 08 18:16:26 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:27 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f" returned: 0 in 0.981s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:27 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f Jul 08 18:16:27 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:27 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f" returned: 0 in 0.772s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "cinder-quobyte-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f" released by "delete_volume" :: held 1.840s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:28 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Created reservations ['b64cda88-6644-4fca-90e0-51336d485b73', 'e0652d9b-261d-489c-bf28-6b39d775d60c', 'e4449ec1-c2a5-4612-b754-f4baf9f2c19c', '030f71d8-0f8e-4082-807d-2b18c5f0c78d'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:16:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:28 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:16:28 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:29 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.074s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:29 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:16:29 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Deleted volume successfully. Jul 08 18:16:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e8237e1d-79d0-4f56-af5b-f1c8b15e80ff tempest-AttachVolumeShelveTestJSON-444184322 None] Lock "cinder-eb51ab4d-3188-45d7-b2e8-55b48ddc0a9f-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Flow 'volume_create_manager' (47cf61fe-6338-4c94-9223-24e41d88b4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f010d1-abc9-44a6-97a8-04c7cd5e706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f010d1-abc9-44a6-97a8-04c7cd5e706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1663234695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a86c9b-161d-438d-921f-10c180c53bcd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='786c0cc2cb924f08a23d1bcbe22a8eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:33Z,use_quota=True,user_id='7e41ca10479b4114afc14f68f8a86f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc283143-e437-4528-bb71-77a536a91e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc283143-e437-4528-bb71-77a536a91e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd32171a-5269-4e57-8e2a-8af48f113480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd32171a-5269-4e57-8e2a-8af48f113480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a86c9b-161d-438d-921f-10c180c53bcd', 'volume_name': 'volume-d6a86c9b-161d-438d-921f-10c180c53bcd', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2b2d73-4bde-4c6e-947b-966ec05a8d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2b2d73-4bde-4c6e-947b-966ec05a8d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ac36c6-2ac9-479d-9d72-3e4f2f6fd354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:33 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Volume d6a86c9b-161d-438d-921f-10c180c53bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a86c9b-161d-438d-921f-10c180c53bcd', 'volume_size': 1} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1663234695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a86c9b-161d-438d-921f-10c180c53bcd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='786c0cc2cb924f08a23d1bcbe22a8eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:33Z,use_quota=True,user_id='7e41ca10479b4114afc14f68f8a86f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Creating volume d6a86c9b-161d-438d-921f-10c180c53bcd {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:16:33 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:16:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:33 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd 1073741824 Jul 08 18:16:33 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:34 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd 1073741824" returned: 0 in 1.461s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:34 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd Jul 08 18:16:34 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:35 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd" returned: 0 in 0.989s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:16:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ac36c6-2ac9-479d-9d72-3e4f2f6fd354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a86c9b-161d-438d-921f-10c180c53bcd', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d43c0f-04d1-47a9-a22f-5925d633c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:35 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Volume volume-d6a86c9b-161d-438d-921f-10c180c53bcd (d6a86c9b-161d-438d-921f-10c180c53bcd): created successfully Jul 08 18:16:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d43c0f-04d1-47a9-a22f-5925d633c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Flow 'volume_create_manager' (47cf61fe-6338-4c94-9223-24e41d88b4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-9a206111-44de-402e-ad94-1fa4027df7e9 req-42d1dc2f-e8a2-4e65-8572-977599029acf tempest-VolumesGetTestJSON-972032339 None] Created volume successfully. Jul 08 18:16:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Acquiring lock "cinder-d6a86c9b-161d-438d-921f-10c180c53bcd-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Lock "cinder-d6a86c9b-161d-438d-921f-10c180c53bcd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Acquiring lock "cinder-quobyte-d6a86c9b-161d-438d-921f-10c180c53bcd" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:16:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Lock "cinder-quobyte-d6a86c9b-161d-438d-921f-10c180c53bcd" acquired by "delete_volume" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:16:36 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225f6b5-2881-4d5c-bb82-f79b7b6c4cad]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:16:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:37 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd Jul 08 18:16:37 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:37 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd" returned: 0 in 0.949s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:37 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd Jul 08 18:16:37 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:38 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d6a86c9b-161d-438d-921f-10c180c53bcd" returned: 0 in 0.724s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Lock "cinder-quobyte-d6a86c9b-161d-438d-921f-10c180c53bcd" released by "delete_volume" :: held 1.735s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG cinder.quota [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Created reservations ['e51a6838-0e55-4304-b8e7-0b2fec58d075', 'b7d78950-fc8b-4efc-ba09-30fa9a9b8a12', 'cd2c4e01-29fc-42c6-b31b-11fbea40f0ac', '65651582-f29f-415a-bb19-35dd49956e18'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:38 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:16:38 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:39 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.804s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:39 devstack cinder-volume[87309]: DEBUG cinder.manager [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:16:39 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Deleted volume successfully. Jul 08 18:16:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-f42db420-6f5b-42b8-b02e-bf2010ecaeef req-530b86ac-8f10-42a9-8678-a4d2b22affa7 tempest-VolumesGetTestJSON-972032339 None] Lock "cinder-d6a86c9b-161d-438d-921f-10c180c53bcd-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Flow 'volume_create_manager' (bb949637-d167-43b6-8d1f-0aa4e0ce1929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9f2059-caa1-469c-a305-31f03e62b35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9f2059-caa1-469c-a305-31f03e62b35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202848698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b4246a-7c12-42d3-95ad-0f4583752892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ada18c6d9144408aac9842bfcb906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:48Z,use_quota=True,user_id='071c3460b45e4c358bd77765f781c8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81989c43-51a0-48f4-bef0-1001e356f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81989c43-51a0-48f4-bef0-1001e356f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996f270d-b63e-4b94-aef3-cc0b61e25672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996f270d-b63e-4b94-aef3-cc0b61e25672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b4246a-7c12-42d3-95ad-0f4583752892', 'volume_name': 'volume-71b4246a-7c12-42d3-95ad-0f4583752892', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc82045e-19ff-47f9-b04a-bbd5c9712229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc82045e-19ff-47f9-b04a-bbd5c9712229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b76c655-e837-4a09-b4be-5271b45cbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:47 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Volume 71b4246a-7c12-42d3-95ad-0f4583752892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b4246a-7c12-42d3-95ad-0f4583752892', 'volume_size': 1} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202848698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b4246a-7c12-42d3-95ad-0f4583752892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ada18c6d9144408aac9842bfcb906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:48Z,use_quota=True,user_id='071c3460b45e4c358bd77765f781c8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Creating volume 71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:16:47 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:16:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:47 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 1073741824 Jul 08 18:16:47 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:48 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 1073741824" returned: 0 in 1.169s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:48 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:16:48 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:49 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 1.061s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:16:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b76c655-e837-4a09-b4be-5271b45cbbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b4246a-7c12-42d3-95ad-0f4583752892', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d0f2da-578f-4ab5-bb4e-0a715ecc8124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Volume volume-71b4246a-7c12-42d3-95ad-0f4583752892 (71b4246a-7c12-42d3-95ad-0f4583752892): created successfully Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d0f2da-578f-4ab5-bb4e-0a715ecc8124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Flow 'volume_create_manager' (bb949637-d167-43b6-8d1f-0aa4e0ce1929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1b919061-22c8-463b-8c85-c8d5fabc9c2f tempest-VolumesActionsTest-13460439 None] Created volume successfully. Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Flow 'volume_create_manager' (8e550fb2-da73-4889-bee5-315665a912ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302bd005-b386-4e6d-b0c8-cc8a40eb280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302bd005-b386-4e6d-b0c8-cc8a40eb280b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1878520086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41181d52-8cbc-40a3-ba28-7c50e107307c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560c749048b4c2fa5887b70b29f043a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:50Z,use_quota=True,user_id='ac0bfa9659c94c2eb1aedaf1d29a633d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa379d45-c4d6-4e3f-9d91-b99f5a66f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa379d45-c4d6-4e3f-9d91-b99f5a66f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f4453e-155d-4bf7-90e3-0b7e00ed059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f4453e-155d-4bf7-90e3-0b7e00ed059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41181d52-8cbc-40a3-ba28-7c50e107307c', 'volume_name': 'volume-41181d52-8cbc-40a3-ba28-7c50e107307c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5085f6-e21e-4a8e-b842-8788733c4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5085f6-e21e-4a8e-b842-8788733c4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4a0bf8-5422-406e-ba76-6acbdfbd06c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Volume 41181d52-8cbc-40a3-ba28-7c50e107307c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41181d52-8cbc-40a3-ba28-7c50e107307c', 'volume_size': 1} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1878520086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41181d52-8cbc-40a3-ba28-7c50e107307c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560c749048b4c2fa5887b70b29f043a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:16:50Z,use_quota=True,user_id='ac0bfa9659c94c2eb1aedaf1d29a633d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Creating volume 41181d52-8cbc-40a3-ba28-7c50e107307c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:16:50 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:16:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:50 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c 1073741824 Jul 08 18:16:50 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:51 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c 1073741824" returned: 0 in 1.386s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:51 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c Jul 08 18:16:51 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:52 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c" returned: 0 in 0.942s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] <== create_volume: return (2394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:16:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4a0bf8-5422-406e-ba76-6acbdfbd06c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41181d52-8cbc-40a3-ba28-7c50e107307c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08601447-4aff-4c71-8a4e-cfa6bfdcdc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:16:52 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Volume volume-41181d52-8cbc-40a3-ba28-7c50e107307c (41181d52-8cbc-40a3-ba28-7c50e107307c): created successfully Jul 08 18:16:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08601447-4aff-4c71-8a4e-cfa6bfdcdc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:16:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Flow 'volume_create_manager' (8e550fb2-da73-4889-bee5-315665a912ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:16:52 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=83,cinder:DELETE=9,cinder:SELECT=54,cinder:INSERT=17 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:16:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-83700faa-501a-4cb5-ad21-e4bbce074179 tempest-AttachVolumeTestJSON-700241529 None] Created volume successfully. Jul 08 18:16:53 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=52,cinder:UPDATE=74,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:16:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9b1e5461-e529-42ca-b44d-98fd1402c3d7 req-48be83bc-41f2-4107-af6f-a60b98282b94 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:16:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9b1e5461-e529-42ca-b44d-98fd1402c3d7 req-48be83bc-41f2-4107-af6f-a60b98282b94 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:16:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a07cd-ab32-43d9-8067-65f9fbd1e73b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:16:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9b1e5461-e529-42ca-b44d-98fd1402c3d7 req-48be83bc-41f2-4107-af6f-a60b98282b94 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:16:57 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c Jul 08 18:16:57 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:16:58 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 08 18:16:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9b1e5461-e529-42ca-b44d-98fd1402c3d7 req-48be83bc-41f2-4107-af6f-a60b98282b94 tempest-AttachVolumeTestJSON-700241529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c" returned: 0 in 1.060s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:16:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9b1e5461-e529-42ca-b44d-98fd1402c3d7 req-48be83bc-41f2-4107-af6f-a60b98282b94 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.078s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:16:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9b1e5461-e529-42ca-b44d-98fd1402c3d7 req-48be83bc-41f2-4107-af6f-a60b98282b94 tempest-AttachVolumeTestJSON-700241529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-41181d52-8cbc-40a3-ba28-7c50e107307c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bf9e328-9feb-445b-970f-ce32bd31aecd', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:16:58 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-9b1e5461-e529-42ca-b44d-98fd1402c3d7 req-48be83bc-41f2-4107-af6f-a60b98282b94 tempest-AttachVolumeTestJSON-700241529 None] attachment_update completed successfully. Jul 08 18:17:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:17:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:17:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:17:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:02 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:17:02 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:03 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.910s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:17:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:17:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:17:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:17:08 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:17:08 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:17:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74fd15c0-f163-46b1-a595-e563daf7e51a tempest-VolumesActionsTest-13460439 None] Acquiring lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892" by "attach_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74fd15c0-f163-46b1-a595-e563daf7e51a tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892" acquired by "attach_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:10 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-74fd15c0-f163-46b1-a595-e563daf7e51a tempest-VolumesActionsTest-13460439 None] Attaching volume 71b4246a-7c12-42d3-95ad-0f4583752892 to instance 0f261192-9071-441c-88e0-5b6d5215abd2 at mountpoint /dev/vdb on host None. Jul 08 18:17:10 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-74fd15c0-f163-46b1-a595-e563daf7e51a tempest-VolumesActionsTest-13460439 None] Attach volume completed successfully. Jul 08 18:17:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74fd15c0-f163-46b1-a595-e563daf7e51a tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892" released by "attach_volume" :: held 0.204s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d23f6921-f115-4c37-bd53-30755197ec8f tempest-VolumesActionsTest-13460439 None] Acquiring lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-detach_volume" by "detach_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d23f6921-f115-4c37-bd53-30755197ec8f tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:10 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d23f6921-f115-4c37-bd53-30755197ec8f tempest-VolumesActionsTest-13460439 None] Detaching volume 71b4246a-7c12-42d3-95ad-0f4583752892 from instance 0f261192-9071-441c-88e0-5b6d5215abd2. Jul 08 18:17:10 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d23f6921-f115-4c37-bd53-30755197ec8f tempest-VolumesActionsTest-13460439 None] Detach volume completed successfully. Jul 08 18:17:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d23f6921-f115-4c37-bd53-30755197ec8f tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Flow 'volume_create_manager' (ce741f78-e185-4588-b8b8-280881b902c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a817a6-dbdf-4202-9fbb-82319da1d209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a817a6-dbdf-4202-9fbb-82319da1d209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1979526385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9988d70e-8062-4b0d-9978-13854e56c833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9606a3cb3f10426a8d3317d759d1d76f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:17:12Z,use_quota=True,user_id='06d297c807ef4048acf8b5b1f8310bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5242828c-4972-4f27-93e3-e3995369ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5242828c-4972-4f27-93e3-e3995369ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d3aa6a-4d99-4283-a894-d58585e09a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d3aa6a-4d99-4283-a894-d58585e09a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9988d70e-8062-4b0d-9978-13854e56c833', 'volume_name': 'volume-9988d70e-8062-4b0d-9978-13854e56c833', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f29e7d-3acb-42e4-9cd0-57d9e9e3da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f29e7d-3acb-42e4-9cd0-57d9e9e3da80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fded7bcd-1fab-4208-af6b-34dc85783e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:11 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Volume 9988d70e-8062-4b0d-9978-13854e56c833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9988d70e-8062-4b0d-9978-13854e56c833', 'volume_size': 1} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1979526385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9988d70e-8062-4b0d-9978-13854e56c833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9606a3cb3f10426a8d3317d759d1d76f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:17:12Z,use_quota=True,user_id='06d297c807ef4048acf8b5b1f8310bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Creating volume 9988d70e-8062-4b0d-9978-13854e56c833 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:17:11 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:17:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:11 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 1073741824 Jul 08 18:17:11 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:13 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 1073741824" returned: 0 in 1.218s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:13 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 Jul 08 18:17:13 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:14 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833" returned: 0 in 1.269s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:17:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.599s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fded7bcd-1fab-4208-af6b-34dc85783e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9988d70e-8062-4b0d-9978-13854e56c833', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdba529d-c133-4955-9428-05ac0596596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:14 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Volume volume-9988d70e-8062-4b0d-9978-13854e56c833 (9988d70e-8062-4b0d-9978-13854e56c833): created successfully Jul 08 18:17:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdba529d-c133-4955-9428-05ac0596596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Flow 'volume_create_manager' (ce741f78-e185-4588-b8b8-280881b902c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:17:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3c044866-b654-448d-90fe-299e7b01c9ca tempest-VolumeQuotasNegativeTestJSON-912159580 None] Created volume successfully. Jul 08 18:17:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Acquiring lock "cinder-9988d70e-8062-4b0d-9978-13854e56c833-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "cinder-9988d70e-8062-4b0d-9978-13854e56c833-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Acquiring lock "cinder-quobyte-9988d70e-8062-4b0d-9978-13854e56c833" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "cinder-quobyte-9988d70e-8062-4b0d-9978-13854e56c833" acquired by "delete_volume" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5875a62b-5d3c-4429-a5b2-1013f99ca846]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:16 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 Jul 08 18:17:16 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:17 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833" returned: 0 in 1.185s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:17 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833 Jul 08 18:17:17 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:19 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9988d70e-8062-4b0d-9978-13854e56c833" returned: 0 in 1.441s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "cinder-quobyte-9988d70e-8062-4b0d-9978-13854e56c833" released by "delete_volume" :: held 2.720s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Created reservations ['5fb503ac-4e0c-43fd-8204-9d2351528b57', 'd3ecedaf-feef-43cd-a906-0a569f2f1eb5', '64cca804-80ea-40ce-9d39-4989bdd183e5', '97c59472-99a4-43b3-acb6-aba092576974'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:19 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:17:19 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:20 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.127s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:20 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:17:20 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Deleted volume successfully. Jul 08 18:17:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5469e41c-1023-4e2a-acaa-606b4b42f010 tempest-VolumeQuotasNegativeTestJSON-912159580 None] Lock "cinder-9988d70e-8062-4b0d-9978-13854e56c833-delete_volume" released by "delete_volume" :: held 4.144s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:29 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:17:30 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:INSERT=4,cinder:SELECT=12,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Flow 'volume_create_manager' (7374305d-6e71-4d37-937c-a7ccc04546cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79d587a-50f5-4f80-b060-633c77a17d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79d587a-50f5-4f80-b060-633c77a17d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-3234110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a8a1d4-0288-4bd7-bbd4-92659de267f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3d206bb964870883c09d7d9985907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:17:34Z,use_quota=True,user_id='7509922bbdf840e296327039cf587860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c930494a-c75d-468d-bcd1-23cff5217a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c930494a-c75d-468d-bcd1-23cff5217a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29fa97f-babd-4764-999a-d7ef1db3f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29fa97f-babd-4764-999a-d7ef1db3f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a8a1d4-0288-4bd7-bbd4-92659de267f7', 'volume_name': 'volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8bccec2-1fec-432d-a80f-ed32d9bb6b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8bccec2-1fec-432d-a80f-ed32d9bb6b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134c2387-8b37-4ee4-9e39-752368c38714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:34 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Volume 40a8a1d4-0288-4bd7-bbd4-92659de267f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7', 'volume_size': 1} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-3234110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a8a1d4-0288-4bd7-bbd4-92659de267f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d3d206bb964870883c09d7d9985907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:17:34Z,use_quota=True,user_id='7509922bbdf840e296327039cf587860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Creating volume 40a8a1d4-0288-4bd7-bbd4-92659de267f7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:17:34 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:17:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:34 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 1073741824 Jul 08 18:17:34 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:35 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 1073741824" returned: 0 in 0.844s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:35 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 Jul 08 18:17:35 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:35 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7" returned: 0 in 0.670s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134c2387-8b37-4ee4-9e39-752368c38714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcb8353-f6e3-4585-aabf-e0bfb6cd407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:35 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Volume volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 (40a8a1d4-0288-4bd7-bbd4-92659de267f7): created successfully Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcb8353-f6e3-4585-aabf-e0bfb6cd407a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Flow 'volume_create_manager' (7374305d-6e71-4d37-937c-a7ccc04546cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:17:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-298a19ce-7626-4b16-840c-155452b722dc tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Created volume successfully. Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Flow 'volume_create_manager' (74069e7e-0db2-4e71-a8d3-ec5178cfd296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b687f16-5237-4b4a-a77e-ba71b1a2da06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b687f16-5237-4b4a-a77e-ba71b1a2da06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-127371132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a82be5c-9862-4260-aa04-70e8c6fb922c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbbe511fea34e918cb5775181016203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:17:36Z,use_quota=True,user_id='28d0751fdccf432bb072782ea2ee9779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5f5e2d-f91b-4ecd-af65-cf08823b4e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5f5e2d-f91b-4ecd-af65-cf08823b4e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a7ed7a-d978-4f56-976d-c83ae0819396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a7ed7a-d978-4f56-976d-c83ae0819396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a82be5c-9862-4260-aa04-70e8c6fb922c', 'volume_name': 'volume-0a82be5c-9862-4260-aa04-70e8c6fb922c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d352cbd0-77be-412a-8ff6-70334f6a50ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d352cbd0-77be-412a-8ff6-70334f6a50ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3badbeef-3961-4849-ab70-de06f318f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:36 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Volume 0a82be5c-9862-4260-aa04-70e8c6fb922c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a82be5c-9862-4260-aa04-70e8c6fb922c', 'volume_size': 1} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-127371132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a82be5c-9862-4260-aa04-70e8c6fb922c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbbe511fea34e918cb5775181016203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:17:36Z,use_quota=True,user_id='28d0751fdccf432bb072782ea2ee9779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Creating volume 0a82be5c-9862-4260-aa04-70e8c6fb922c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:17:36 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:36 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c 1073741824 Jul 08 18:17:36 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:37 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c 1073741824" returned: 0 in 0.895s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:37 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c Jul 08 18:17:37 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:38 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c" returned: 0 in 0.672s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.584s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3badbeef-3961-4849-ab70-de06f318f799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a82be5c-9862-4260-aa04-70e8c6fb922c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569f8298-97f9-4189-80bf-562d4bb45c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Creating offline snapshot 50a12525-7129-4091-be0e-f4bb966ca909 of volume 40a8a1d4-0288-4bd7-bbd4-92659de267f7 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16deff3d-9907-4c37-ba3d-0798f70875ce tempest-VolumesActionsTest-13460439 None] Acquiring lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892" by "attach_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Volume volume-0a82be5c-9862-4260-aa04-70e8c6fb922c (0a82be5c-9862-4260-aa04-70e8c6fb922c): created successfully Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569f8298-97f9-4189-80bf-562d4bb45c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Flow 'volume_create_manager' (74069e7e-0db2-4e71-a8d3-ec5178cfd296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae98728-b014-4916-b6f6-0096268b6a74]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dbcdb2dc-f17c-4a78-bd90-903e7090b44e tempest-AttachVolumeNegativeTest-1469097328 None] Created volume successfully. Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16deff3d-9907-4c37-ba3d-0798f70875ce tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892" acquired by "attach_volume" :: waited 0.048s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-16deff3d-9907-4c37-ba3d-0798f70875ce tempest-VolumesActionsTest-13460439 None] Attaching volume 71b4246a-7c12-42d3-95ad-0f4583752892 to instance da56f4f5-48bf-4bfc-ad5d-71594c62de5d at mountpoint /dev/vdb on host None. Jul 08 18:17:38 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 Jul 08 18:17:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-16deff3d-9907-4c37-ba3d-0798f70875ce tempest-VolumesActionsTest-13460439 None] Attach volume completed successfully. Jul 08 18:17:38 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16deff3d-9907-4c37-ba3d-0798f70875ce tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892" released by "attach_volume" :: held 0.115s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cd69f863-58d8-4546-bfd2-d380488258a7 tempest-VolumesActionsTest-13460439 None] Acquiring lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-detach_volume" by "detach_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cd69f863-58d8-4546-bfd2-d380488258a7 tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-cd69f863-58d8-4546-bfd2-d380488258a7 tempest-VolumesActionsTest-13460439 None] Detaching volume 71b4246a-7c12-42d3-95ad-0f4583752892 from instance da56f4f5-48bf-4bfc-ad5d-71594c62de5d. Jul 08 18:17:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-cd69f863-58d8-4546-bfd2-d380488258a7 tempest-VolumesActionsTest-13460439 None] Detach volume completed successfully. Jul 08 18:17:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cd69f863-58d8-4546-bfd2-d380488258a7 tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:39 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7" returned: 0 in 0.807s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:39 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 1G Jul 08 18:17:39 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:39 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 1G" returned: 0 in 0.882s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:39 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 Jul 08 18:17:39 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:40 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909" returned: 0 in 0.671s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:40 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 is being set with open permissions: ugo+rw Jul 08 18:17:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:40 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 Jul 08 18:17:40 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:41 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909" returned: 0 in 0.649s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:41 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.info Jul 08 18:17:41 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9d3d4ba1-c4b8-41c0-b9cf-6d630a181be3 req-7252f75c-6f44-4763-b0af-69b4322aea37 tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:42 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.info" returned: 0 in 1.024s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:42 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.info is being set with open permissions: ugo+rw Jul 08 18:17:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:42 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.info Jul 08 18:17:42 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:43 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.info" returned: 0 in 0.782s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.969s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9d3d4ba1-c4b8-41c0-b9cf-6d630a181be3 req-7252f75c-6f44-4763-b0af-69b4322aea37 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.288s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fa3ebe-6051-45d7-8425-f5abb3e3d1f2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9d3d4ba1-c4b8-41c0-b9cf-6d630a181be3 req-7252f75c-6f44-4763-b0af-69b4322aea37 tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0eefdca0-2bbc-4af2-b7ce-9a8c1b26e15f tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Create snapshot completed successfully Jul 08 18:17:43 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c Jul 08 18:17:43 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:43 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9d3d4ba1-c4b8-41c0-b9cf-6d630a181be3 req-7252f75c-6f44-4763-b0af-69b4322aea37 tempest-AttachVolumeNegativeTest-1469097328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c" returned: 0 in 0.744s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9d3d4ba1-c4b8-41c0-b9cf-6d630a181be3 req-7252f75c-6f44-4763-b0af-69b4322aea37 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9d3d4ba1-c4b8-41c0-b9cf-6d630a181be3 req-7252f75c-6f44-4763-b0af-69b4322aea37 tempest-AttachVolumeNegativeTest-1469097328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-0a82be5c-9862-4260-aa04-70e8c6fb922c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f4e2483-7c27-42dd-8dae-08eb2aff2066', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:17:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-9d3d4ba1-c4b8-41c0-b9cf-6d630a181be3 req-7252f75c-6f44-4763-b0af-69b4322aea37 tempest-AttachVolumeNegativeTest-1469097328 None] attachment_update completed successfully. Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "cinder-50a12525-7129-4091-be0e-f4bb966ca909-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-50a12525-7129-4091-be0e-f4bb966ca909-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "cinder-quobyte-40a8a1d4-0288-4bd7-bbd4-92659de267f7" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-quobyte-40a8a1d4-0288-4bd7-bbd4-92659de267f7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "cinder-quobyte-50a12525-7129-4091-be0e-f4bb966ca909" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-quobyte-50a12525-7129-4091-be0e-f4bb966ca909" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Deleting offline snapshot 50a12525-7129-4091-be0e-f4bb966ca909 of volume 40a8a1d4-0288-4bd7-bbd4-92659de267f7 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] snapshot_file for this snap is: volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[709521dd-d252-4a99-8043-ba81efab2975]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:44 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 Jul 08 18:17:44 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:45 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909" returned: 0 in 0.804s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:17:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ef617f-81f6-4bd1-9fbc-692c3260fa2a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:45 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 Jul 08 18:17:45 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-4b01ff10-7f91-40aa-8780-09551543e83b req-c15bd7ee-5cbc-4c4a-862b-51c76a9c416f tempest-AttachVolumeTestJSON-700241529 None] Terminate volume connection completed successfully. Jul 08 18:17:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-4b01ff10-7f91-40aa-8780-09551543e83b req-c15bd7ee-5cbc-4c4a-862b-51c76a9c416f tempest-AttachVolumeTestJSON-700241529 None] Deleting attachment 5bf9e328-9feb-445b-970f-ce32bd31aecd. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:17:46 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7" returned: 0 in 0.835s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:46 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 Jul 08 18:17:46 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:46 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909" returned: 0 in 0.746s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:46 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909 Jul 08 18:17:46 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:47 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7.50a12525-7129-4091-be0e-f4bb966ca909" returned: 0 in 0.767s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-quobyte-50a12525-7129-4091-be0e-f4bb966ca909" released by "_delete_snapshot" :: held 3.308s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-quobyte-40a8a1d4-0288-4bd7-bbd4-92659de267f7" released by "delete_snapshot" :: held 3.348s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:47 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Created reservations ['cf86a8d3-2ade-4622-a390-9a82dc609390', '35fe0ae8-e2e8-4ad5-8738-1fe15545bb9c', 'f29f3a7f-8d3c-4eca-b7b9-57b85d33eff1', '961e4e15-f322-4b74-a0cd-2e39ad503bd8'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:17:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Delete snapshot completed successfully. Jul 08 18:17:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2651b1a7-965d-4e11-bb7f-ad7602c2a57c tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-50a12525-7129-4091-be0e-f4bb966ca909-delete_snapshot" released by "delete_snapshot" :: held 3.501s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "cinder-40a8a1d4-0288-4bd7-bbd4-92659de267f7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-40a8a1d4-0288-4bd7-bbd4-92659de267f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "cinder-quobyte-40a8a1d4-0288-4bd7-bbd4-92659de267f7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-quobyte-40a8a1d4-0288-4bd7-bbd4-92659de267f7" acquired by "delete_volume" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd120eea-8185-417e-ae2e-00c4bc92aceb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d972bb0-c1c0-4a2f-8fca-a337990f90cd]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:48 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 Jul 08 18:17:49 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:49 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:17:49 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:49 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7" returned: 0 in 0.944s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:49 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7 Jul 08 18:17:49 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:49 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 0.933s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3792dc2c-cb82-4383-85c1-a6d5643121a1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:50 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:17:50 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:50 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a8a1d4-0288-4bd7-bbd4-92659de267f7" returned: 0 in 0.698s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-quobyte-40a8a1d4-0288-4bd7-bbd4-92659de267f7" released by "delete_volume" :: held 1.719s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Created reservations ['7a24a85a-79c8-4a57-9524-a44b135d021b', '5ceb0aee-de52-4779-84d5-b082024a9ba3', '9b0982fc-7a62-4ce7-a5cb-adfb4d06e991', 'd2c8f940-a675-4b65-9aa3-bca4259bd217'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:50 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:17:50 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:50 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 0.846s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.650f38f2-46e2-4131-be58-c68b44d4fac1bnnmudel.img {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:50 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.650f38f2-46e2-4131-be58-c68b44d4fac1bnnmudel.img Jul 08 18:17:50 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:51 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.978s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:51 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:17:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Deleted volume successfully. Jul 08 18:17:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00b5caa4-55d1-417b-9d54-ba33b374bd19 tempest-VolumeSnapshotQuotasNegativeTestJSON-531070116 None] Lock "cinder-40a8a1d4-0288-4bd7-bbd4-92659de267f7-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:17:56 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.650f38f2-46e2-4131-be58-c68b44d4fac1bnnmudel.img" returned: 0 in 5.948s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:56 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[258adf12-dd70-42a8-9cce-44b44977d5ba]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:17:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:17:56 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:17:56 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:17:57 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 08 18:17:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 0.979s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:17:57 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.650f38f2-46e2-4131-be58-c68b44d4fac1bnnmudel.img {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:17:57 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Converted 1024.00 MB image at 172.14 MB/s Jul 08 18:17:57 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] 650f38f2-46e2-4131-be58-c68b44d4fac1 was raw, no need to convert to raw {{(pid=87309) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:02 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:18:02 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Flow 'volume_create_manager' (47fb3fcd-b3df-45fa-b2ef-770a9b38c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:18:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0146eb-03f4-4acc-8aae-4865c8a9d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0146eb-03f4-4acc-8aae-4865c8a9d43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2081462535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd14d9b-39cc-4f96-9514-168fe4187aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c3e24c2a1d4670a52e6c77f7976747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:18:03Z,use_quota=True,user_id='d614cacd7f514a5f84aad34de5e43169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11266b03-f891-4d72-8f5c-b91afcf795a1),volume_type_id=11266b03-f891-4d72-8f5c-b91afcf795a1)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4a4d3a-7ac5-4185-b2c5-b5ab73f75e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4a4d3a-7ac5-4185-b2c5-b5ab73f75e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd1e4fb-8c55-437b-95a0-9ef47ad952c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd1e4fb-8c55-437b-95a0-9ef47ad952c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd14d9b-39cc-4f96-9514-168fe4187aaa', 'volume_name': 'volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3552f630-3383-449a-be9e-61699f99d0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3552f630-3383-449a-be9e-61699f99d0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbdf1f3-04e2-476a-9e63-7d58d94b0c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:03 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Volume 5fd14d9b-39cc-4f96-9514-168fe4187aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa', 'volume_size': 1} Jul 08 18:18:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:18:04 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.789s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:04 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:18:04 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:18:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:18:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:18:12 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:18:12 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=27,cinder:SELECT=28,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.188s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Uploaded volume to glance image-id: 650f38f2-46e2-4131-be58-c68b44d4fac1. {{(pid=87309) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.804s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2081462535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd14d9b-39cc-4f96-9514-168fe4187aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7c3e24c2a1d4670a52e6c77f7976747',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:18:03Z,use_quota=True,user_id='d614cacd7f514a5f84aad34de5e43169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11266b03-f891-4d72-8f5c-b91afcf795a1),volume_type_id=11266b03-f891-4d72-8f5c-b91afcf795a1)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Creating volume 5fd14d9b-39cc-4f96-9514-168fe4187aaa {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:18:24 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:24 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa 1073741824 Jul 08 18:18:24 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:24 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0df55af0-186a-4be4-90dd-3873b6c9af86 tempest-VolumesActionsTest-13460439 None] Copy volume to image completed successfully. Jul 08 18:18:24 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa 1073741824" returned: 0 in 0.863s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:25 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa Jul 08 18:18:25 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:25 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa" returned: 0 in 0.758s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:18:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:18:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbdf1f3-04e2-476a-9e63-7d58d94b0c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a814b092-6d47-4853-a722-6249912db365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:25 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Volume volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa (5fd14d9b-39cc-4f96-9514-168fe4187aaa): created successfully Jul 08 18:18:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a814b092-6d47-4853-a722-6249912db365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Flow 'volume_create_manager' (47fb3fcd-b3df-45fa-b2ef-770a9b38c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:18:25 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0ed035e2-3cde-4939-8f5e-01613e896866 tempest-VolumeTypesAccessTest-1965602177 None] Created volume successfully. Jul 08 18:18:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:18:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:18:26 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe165b-56b7-4adb-8b32-3fb2221c375c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:18:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:26 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:18:26 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Acquiring lock "cinder-5fd14d9b-39cc-4f96-9514-168fe4187aaa-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:18:27 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 0.834s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Lock "cinder-5fd14d9b-39cc-4f96-9514-168fe4187aaa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a9e2bb-d057-4776-bfd2-6330a93ce26d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Acquiring lock "cinder-quobyte-5fd14d9b-39cc-4f96-9514-168fe4187aaa" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Lock "cinder-quobyte-5fd14d9b-39cc-4f96-9514-168fe4187aaa" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc533632-4af1-43dd-80ef-90609fd0d3da]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:18:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:27 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:18:27 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:27 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa Jul 08 18:18:27 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:28 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:28 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 1.044s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa" returned: 0 in 0.958s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:28 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img Jul 08 18:18:28 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:28 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa Jul 08 18:18:28 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:28 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5fd14d9b-39cc-4f96-9514-168fe4187aaa" returned: 0 in 0.823s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Lock "cinder-quobyte-5fd14d9b-39cc-4f96-9514-168fe4187aaa" released by "delete_volume" :: held 1.850s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:18:29 devstack cinder-volume[87309]: WARNING cinder.quota [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1761758634 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1761758634, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:18:29 devstack cinder-volume[87309]: WARNING cinder.quota [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1761758634 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1761758634, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:18:29 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Created reservations ['f44e9aaa-bb4d-486c-902e-0f383e455f4a', '8a5f0a61-1edb-4214-a0cf-113d10c273ec', '2d210c9f-e7d8-4b40-a6b9-c6be4d9139ce', '7b0f9c3b-0636-494a-92a8-98bee9afcd7e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:18:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:18:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:18:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:18:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:18:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:18:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:29 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:18:29 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:31 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.771s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:31 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:18:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Deleted volume successfully. Jul 08 18:18:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47d6f837-e62f-485e-b661-8cb53c66d74d tempest-VolumeTypesAccessTest-1965602177 None] Lock "cinder-5fd14d9b-39cc-4f96-9514-168fe4187aaa-delete_volume" released by "delete_volume" :: held 4.293s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:18:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img" returned: 0 in 6.123s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:34 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[15307b7f-fb4a-4516-ba08-d97b7050c90a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:18:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:34 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:18:34 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:35 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 1.177s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:35 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:18:35 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Converted 1024.00 MB image at 167.21 MB/s Jul 08 18:18:35 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] 751c52bc-2b06-47d2-8432-9fbad0bd90fe was raw, converting to qcow2 {{(pid=87309) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 18:18:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9dd953-aee0-4910-8365-d012e344d316]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:18:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:35 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img Jul 08 18:18:35 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:36 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img" returned: 0 in 0.813s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:36 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img Jul 08 18:18:36 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:37 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img" returned: 1 in 0.907s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:18:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img /opt/stack/data/cinder/conversion/vol_upload_8r6moqtu {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:37 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img /opt/stack/data/cinder/conversion/vol_upload_8r6moqtu Jul 08 18:18:37 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:38 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img /opt/stack/data/cinder/conversion/vol_upload_8r6moqtu" returned: 0 in 0.923s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:38 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Image conversion details: src /opt/stack/data/cinder/conversion/71b4246a-7c12-42d3-95ad-0f4583752892.temp_image.751c52bc-2b06-47d2-8432-9fbad0bd90feep2jo17z.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8r6moqtu {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:18:38 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 18:18:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c3fdbe-67f9-4300-bd63-c70655f332b1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:18:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8r6moqtu {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:38 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8r6moqtu Jul 08 18:18:38 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:39 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8r6moqtu" returned: 0 in 1.027s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.678s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:18:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Uploaded volume to glance image-id: 751c52bc-2b06-47d2-8432-9fbad0bd90fe. {{(pid=87309) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 18:18:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9c89b360-fe14-4d17-b78e-ea8e9c1a75e8 tempest-VolumesActionsTest-13460439 None] Copy volume to image completed successfully. Jul 08 18:18:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Acquiring lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:18:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:18:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Acquiring lock "cinder-quobyte-71b4246a-7c12-42d3-95ad-0f4583752892" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:18:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Lock "cinder-quobyte-71b4246a-7c12-42d3-95ad-0f4583752892" acquired by "delete_volume" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:18:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3821115-6d32-4c43-9443-c8d5840d5d1d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:18:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:41 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:18:41 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:42 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 0.890s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:42 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892 Jul 08 18:18:42 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:43 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-71b4246a-7c12-42d3-95ad-0f4583752892" returned: 0 in 0.678s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Lock "cinder-quobyte-71b4246a-7c12-42d3-95ad-0f4583752892" released by "delete_volume" :: held 1.618s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Created reservations ['55aac86f-513b-4381-9f32-e0d75637e973', '8b565b4b-aeea-4ed0-871c-5bccf71d0e75', 'f4bccd05-4ee9-4a3b-8e97-898091cb9ea1', 'f7fb559a-aec0-42e4-97ec-352ef6c87056'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:18:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:43 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:18:43 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:44 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.893s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:44 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:18:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Deleted volume successfully. Jul 08 18:18:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-17d6f315-28bb-45b2-96e5-6931814cc6cf tempest-VolumesActionsTest-13460439 None] Lock "cinder-71b4246a-7c12-42d3-95ad-0f4583752892-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:18:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-67127283-fa8b-4191-ac2c-60d934bd75b5 req-aa21973a-bbe9-4900-aec6-bb1ed6b1bf7c tempest-AttachVolumeNegativeTest-1469097328 None] Terminate volume connection completed successfully. Jul 08 18:18:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-67127283-fa8b-4191-ac2c-60d934bd75b5 req-aa21973a-bbe9-4900-aec6-bb1ed6b1bf7c tempest-AttachVolumeNegativeTest-1469097328 None] Deleting attachment 3f4e2483-7c27-42dd-8dae-08eb2aff2066. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:18:56 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=17,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:18:56 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=21,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Flow 'volume_create_manager' (3e392291-520f-4e7a-8ca5-f421ac3da2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264a98be-ba47-469f-8798-b9d3d95b305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264a98be-ba47-469f-8798-b9d3d95b305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1785822310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c3de3a-bb56-4544-8f19-bf6e4f218d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae28a3ef27234838919dae6404ec501b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:18:58Z,use_quota=True,user_id='ad48b0823ad9459d8dbed1368d91ee95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe87d870-66b1-443b-92df-e6bac67a6e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe87d870-66b1-443b-92df-e6bac67a6e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74772b8d-762c-4903-bb2c-7715001487d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74772b8d-762c-4903-bb2c-7715001487d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c3de3a-bb56-4544-8f19-bf6e4f218d23', 'volume_name': 'volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f332ff36-00cc-4425-8483-f3f93f0439c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f332ff36-00cc-4425-8483-f3f93f0439c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3839d4c2-2f05-48e8-9017-4023900bc1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:18:57 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Volume 78c3de3a-bb56-4544-8f19-bf6e4f218d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23', 'volume_size': 1} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1785822310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c3de3a-bb56-4544-8f19-bf6e4f218d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae28a3ef27234838919dae6404ec501b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:18:58Z,use_quota=True,user_id='ad48b0823ad9459d8dbed1368d91ee95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Creating volume 78c3de3a-bb56-4544-8f19-bf6e4f218d23 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:18:57 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:18:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:57 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 1073741824 Jul 08 18:18:57 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:18:59 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 08 18:18:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 1073741824" returned: 0 in 1.531s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:18:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:18:59 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 Jul 08 18:18:59 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:00 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23" returned: 0 in 0.915s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] <== create_volume: return (2554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:19:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.556s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3839d4c2-2f05-48e8-9017-4023900bc1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c12821b-f865-41b4-b4d3-1c3c48846ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:00 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Volume volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 (78c3de3a-bb56-4544-8f19-bf6e4f218d23): created successfully Jul 08 18:19:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c12821b-f865-41b4-b4d3-1c3c48846ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Flow 'volume_create_manager' (3e392291-520f-4e7a-8ca5-f421ac3da2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4ecc4142-5c20-4857-b179-ebb969ca6cc8 tempest-VolumesNegativeTest-674786742 None] Created volume successfully. Jul 08 18:19:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:19:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:02 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:19:02 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:03 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.328s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:19:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:19:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:19:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:19:10 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:19:10 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Flow 'volume_create_manager' (1e7217e1-39ab-42fd-82b0-3e4e5de2df8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abcdca7-ff0b-44b7-b772-cd9c0d4b8653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abcdca7-ff0b-44b7-b772-cd9c0d4b8653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-334187251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd25d325-03b0-4697-9949-fc735c80952b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560c749048b4c2fa5887b70b29f043a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:19Z,use_quota=True,user_id='ac0bfa9659c94c2eb1aedaf1d29a633d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ef8e92-ab08-4f0d-b64f-d209cbb71fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ef8e92-ab08-4f0d-b64f-d209cbb71fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6212f8e8-8c95-47b2-83ef-a7ac4dddc75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6212f8e8-8c95-47b2-83ef-a7ac4dddc75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd25d325-03b0-4697-9949-fc735c80952b', 'volume_name': 'volume-fd25d325-03b0-4697-9949-fc735c80952b', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35fa2d1-19a9-4038-930a-97b607fe22e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35fa2d1-19a9-4038-930a-97b607fe22e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2334f113-3207-4bf3-97ab-88db0974ce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:19 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Volume fd25d325-03b0-4697-9949-fc735c80952b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd25d325-03b0-4697-9949-fc735c80952b', 'volume_size': 1} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-334187251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd25d325-03b0-4697-9949-fc735c80952b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560c749048b4c2fa5887b70b29f043a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:19Z,use_quota=True,user_id='ac0bfa9659c94c2eb1aedaf1d29a633d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Creating volume fd25d325-03b0-4697-9949-fc735c80952b {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:19:19 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:19:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:19 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b 1073741824 Jul 08 18:19:19 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:21 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b 1073741824" returned: 0 in 1.550s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:21 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b Jul 08 18:19:21 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:22 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b" returned: 0 in 1.109s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] <== create_volume: return (2720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:19:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.725s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2334f113-3207-4bf3-97ab-88db0974ce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd25d325-03b0-4697-9949-fc735c80952b', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ef9489-5d52-45ea-b665-025b39347026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:22 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Volume volume-fd25d325-03b0-4697-9949-fc735c80952b (fd25d325-03b0-4697-9949-fc735c80952b): created successfully Jul 08 18:19:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ef9489-5d52-45ea-b665-025b39347026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Flow 'volume_create_manager' (1e7217e1-39ab-42fd-82b0-3e4e5de2df8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:22 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ce10756b-05e1-4639-bca0-f297028f9992 tempest-AttachVolumeTestJSON-700241529 None] Created volume successfully. Jul 08 18:19:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-aaec95d6-074a-402e-865e-3cd24342e082 req-ccafbc48-dd5d-40a9-8d44-a7f8c827479e tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-aaec95d6-074a-402e-865e-3cd24342e082 req-ccafbc48-dd5d-40a9-8d44-a7f8c827479e tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:26 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ed8ec3-3408-4b70-9bba-0fe8dd9f0610]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:19:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-aaec95d6-074a-402e-865e-3cd24342e082 req-ccafbc48-dd5d-40a9-8d44-a7f8c827479e tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:26 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b Jul 08 18:19:26 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:27 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-aaec95d6-074a-402e-865e-3cd24342e082 req-ccafbc48-dd5d-40a9-8d44-a7f8c827479e tempest-AttachVolumeTestJSON-700241529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b" returned: 0 in 1.387s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-aaec95d6-074a-402e-865e-3cd24342e082 req-ccafbc48-dd5d-40a9-8d44-a7f8c827479e tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.420s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-aaec95d6-074a-402e-865e-3cd24342e082 req-ccafbc48-dd5d-40a9-8d44-a7f8c827479e tempest-AttachVolumeTestJSON-700241529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-fd25d325-03b0-4697-9949-fc735c80952b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d98e7ed-8f16-492f-b0a2-eebb1596a188', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:19:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-aaec95d6-074a-402e-865e-3cd24342e082 req-ccafbc48-dd5d-40a9-8d44-a7f8c827479e tempest-AttachVolumeTestJSON-700241529 None] attachment_update completed successfully. Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (db044c24-6860-4120-8adb-d1641b403e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f54f086-a3e1-496d-a1ff-504b548cd6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f54f086-a3e1-496d-a1ff-504b548cd6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-875156086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5718f749-6ab7-4346-975a-93bd5c56555c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:34Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1923798-0688-486d-ab16-d22d51f3754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1923798-0688-486d-ab16-d22d51f3754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afcfb17-cc5e-43bf-bd07-b7177e725c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afcfb17-cc5e-43bf-bd07-b7177e725c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5718f749-6ab7-4346-975a-93bd5c56555c', 'volume_name': 'volume-5718f749-6ab7-4346-975a-93bd5c56555c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1a570e-6754-4a32-a656-84eb0a13f14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1a570e-6754-4a32-a656-84eb0a13f14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8b3f12-782f-402f-b5b2-c3de288c6a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Volume 5718f749-6ab7-4346-975a-93bd5c56555c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5718f749-6ab7-4346-975a-93bd5c56555c', 'volume_size': 1} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-875156086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5718f749-6ab7-4346-975a-93bd5c56555c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:34Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Creating volume 5718f749-6ab7-4346-975a-93bd5c56555c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:19:34 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:34 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c 1073741824 Jul 08 18:19:34 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Flow 'volume_create_manager' (a4940e41-5922-4b9f-8d79-e30f85b3d8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530da55f-cbda-4fe7-80dd-325c3eaae677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530da55f-cbda-4fe7-80dd-325c3eaae677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1170475962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa4a105-c437-43ce-9b1d-18ff38737777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560c749048b4c2fa5887b70b29f043a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:34Z,use_quota=True,user_id='ac0bfa9659c94c2eb1aedaf1d29a633d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2031da-d7a2-410f-b482-b3a8ba222c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2031da-d7a2-410f-b482-b3a8ba222c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ba2c5a-413a-4de1-be07-7606f7b18890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ba2c5a-413a-4de1-be07-7606f7b18890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa4a105-c437-43ce-9b1d-18ff38737777', 'volume_name': 'volume-cfa4a105-c437-43ce-9b1d-18ff38737777', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba2ea4a-af1f-4723-940b-f14833a29cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba2ea4a-af1f-4723-940b-f14833a29cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ec76db-7840-4ffd-8378-ed85525ec18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:34 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Volume cfa4a105-c437-43ce-9b1d-18ff38737777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa4a105-c437-43ce-9b1d-18ff38737777', 'volume_size': 1} Jul 08 18:19:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:35 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c 1073741824" returned: 0 in 1.014s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:35 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c Jul 08 18:19:35 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:36 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c" returned: 0 in 0.816s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.632s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1170475962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa4a105-c437-43ce-9b1d-18ff38737777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6560c749048b4c2fa5887b70b29f043a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:34Z,use_quota=True,user_id='ac0bfa9659c94c2eb1aedaf1d29a633d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Creating volume cfa4a105-c437-43ce-9b1d-18ff38737777 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:19:36 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8b3f12-782f-402f-b5b2-c3de288c6a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5718f749-6ab7-4346-975a-93bd5c56555c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf18f77-df45-4eb9-a4b1-0d9874aa0c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:36 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 1073741824 Jul 08 18:19:36 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:36 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Volume volume-5718f749-6ab7-4346-975a-93bd5c56555c (5718f749-6ab7-4346-975a-93bd5c56555c): created successfully Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf18f77-df45-4eb9-a4b1-0d9874aa0c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (db044c24-6860-4120-8adb-d1641b403e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0cebaf85-a944-4265-b6e2-a5fb679cc46c tempest-VolumesActionsTest-596353583 None] Created volume successfully. Jul 08 18:19:37 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 1073741824" returned: 0 in 1.107s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a55edc4-4d95-42a3-8154-5e3470599786 tempest-VolumesActionsTest-596353583 None] Acquiring lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c" by "attach_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:37 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 Jul 08 18:19:37 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a55edc4-4d95-42a3-8154-5e3470599786 tempest-VolumesActionsTest-596353583 None] Lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c" acquired by "attach_volume" :: waited 0.048s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7a55edc4-4d95-42a3-8154-5e3470599786 tempest-VolumesActionsTest-596353583 None] Attaching volume 5718f749-6ab7-4346-975a-93bd5c56555c to instance 0836259b-df25-4a7e-914e-0c687f99c096 at mountpoint /dev/vdb on host None. Jul 08 18:19:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7a55edc4-4d95-42a3-8154-5e3470599786 tempest-VolumesActionsTest-596353583 None] Attach volume completed successfully. Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a55edc4-4d95-42a3-8154-5e3470599786 tempest-VolumesActionsTest-596353583 None] Lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c" released by "attach_volume" :: held 0.149s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:37 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777" returned: 0 in 0.656s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ec76db-7840-4ffd-8378-ed85525ec18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa4a105-c437-43ce-9b1d-18ff38737777', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043483b9-7857-49ce-8655-58d0b29d0bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Volume volume-cfa4a105-c437-43ce-9b1d-18ff38737777 (cfa4a105-c437-43ce-9b1d-18ff38737777): created successfully Jul 08 18:19:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043483b9-7857-49ce-8655-58d0b29d0bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Flow 'volume_create_manager' (a4940e41-5922-4b9f-8d79-e30f85b3d8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d0ff0792-4faf-407d-b3ed-8dff3f660e19 tempest-AttachVolumeTestJSON-700241529 None] Created volume successfully. Jul 08 18:19:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-77ca1cd9-1b05-44cf-a1cf-68c57a045c06 tempest-VolumesActionsTest-759292681 None] Terminate volume connection completed successfully. Jul 08 18:19:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77ca1cd9-1b05-44cf-a1cf-68c57a045c06 tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-detach_volume" by "detach_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77ca1cd9-1b05-44cf-a1cf-68c57a045c06 tempest-VolumesActionsTest-759292681 None] Lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-77ca1cd9-1b05-44cf-a1cf-68c57a045c06 tempest-VolumesActionsTest-759292681 None] Detaching volume 5718f749-6ab7-4346-975a-93bd5c56555c from instance 0836259b-df25-4a7e-914e-0c687f99c096. Jul 08 18:19:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-77ca1cd9-1b05-44cf-a1cf-68c57a045c06 tempest-VolumesActionsTest-759292681 None] Detach volume completed successfully. Jul 08 18:19:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77ca1cd9-1b05-44cf-a1cf-68c57a045c06 tempest-VolumesActionsTest-759292681 None] Lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b0d8559-2ff0-4eb9-8812-4e1327a5856c tempest-VolumesActionsTest-596353583 None] Acquiring lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-detach_volume" by "detach_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b0d8559-2ff0-4eb9-8812-4e1327a5856c tempest-VolumesActionsTest-596353583 None] Lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:39 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2b0d8559-2ff0-4eb9-8812-4e1327a5856c tempest-VolumesActionsTest-596353583 None] Volume detach called, but volume not attached. Jul 08 18:19:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2b0d8559-2ff0-4eb9-8812-4e1327a5856c tempest-VolumesActionsTest-596353583 None] Lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Acquiring lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Acquiring lock "cinder-quobyte-5718f749-6ab7-4346-975a-93bd5c56555c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Lock "cinder-quobyte-5718f749-6ab7-4346-975a-93bd5c56555c" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef29c311-de19-4ea3-9175-054822cdc732]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:19:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:40 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c Jul 08 18:19:40 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:41 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c" returned: 0 in 0.948s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:41 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c Jul 08 18:19:41 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Acquiring lock "cinder-78c3de3a-bb56-4544-8f19-bf6e4f218d23-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Lock "cinder-78c3de3a-bb56-4544-8f19-bf6e4f218d23-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Acquiring lock "cinder-quobyte-78c3de3a-bb56-4544-8f19-bf6e4f218d23" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Lock "cinder-quobyte-78c3de3a-bb56-4544-8f19-bf6e4f218d23" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9f8ba7a6-aba0-4d42-9c7d-2a2a939884d9 req-82562fd2-ec87-4476-ab32-4b58f8e4ef0b tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9f8ba7a6-aba0-4d42-9c7d-2a2a939884d9 req-82562fd2-ec87-4476-ab32-4b58f8e4ef0b tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a7244-28a6-4c3f-89f6-76a250bd7f2d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[be206b12-1888-4b69-af01-a1f7b89d9f29]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:19:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9f8ba7a6-aba0-4d42-9c7d-2a2a939884d9 req-82562fd2-ec87-4476-ab32-4b58f8e4ef0b tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:41 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 Jul 08 18:19:41 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:41 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 Jul 08 18:19:41 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:42 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5718f749-6ab7-4346-975a-93bd5c56555c" returned: 0 in 0.953s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Lock "cinder-quobyte-5718f749-6ab7-4346-975a-93bd5c56555c" released by "delete_volume" :: held 1.957s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Created reservations ['8239590e-9e8d-449d-a3b3-447ecc82ab77', '94df627c-d3b7-44a7-9bc8-47bd033e88f9', '2e0eaf0f-8518-4509-b587-1b34bfb68df7', 'd384d634-36e7-4a22-99e2-5db7209064fc'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:19:42 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23" returned: 0 in 0.844s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:42 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-9f8ba7a6-aba0-4d42-9c7d-2a2a939884d9 req-82562fd2-ec87-4476-ab32-4b58f8e4ef0b tempest-AttachVolumeTestJSON-700241529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777" returned: 0 in 0.858s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-9f8ba7a6-aba0-4d42-9c7d-2a2a939884d9 req-82562fd2-ec87-4476-ab32-4b58f8e4ef0b tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.887s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:42 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23 Jul 08 18:19:42 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-9f8ba7a6-aba0-4d42-9c7d-2a2a939884d9 req-82562fd2-ec87-4476-ab32-4b58f8e4ef0b tempest-AttachVolumeTestJSON-700241529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-cfa4a105-c437-43ce-9b1d-18ff38737777', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1470b5a-fad2-4a19-887a-3a38e69ce143', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:19:42 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:19:42 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-9f8ba7a6-aba0-4d42-9c7d-2a2a939884d9 req-82562fd2-ec87-4476-ab32-4b58f8e4ef0b tempest-AttachVolumeTestJSON-700241529 None] attachment_update completed successfully. Jul 08 18:19:43 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78c3de3a-bb56-4544-8f19-bf6e4f218d23" returned: 0 in 0.969s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Lock "cinder-quobyte-78c3de3a-bb56-4544-8f19-bf6e4f218d23" released by "delete_volume" :: held 1.866s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Created reservations ['20f8ca54-de7f-4275-8ee4-18fe986ac98c', 'bce8bd2b-43a8-48ed-889c-a6e1db116722', 'e00ce8a4-a554-4016-af1e-7e66ab8c21a2', 'f8638021-5f22-4d18-8ae1-1900f1693dd4'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:19:43 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.011s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:19:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Deleted volume successfully. Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e42ac16b-ebe0-4815-8357-e9be8ae139f1 tempest-VolumesActionsTest-596353583 None] Lock "cinder-5718f749-6ab7-4346-975a-93bd5c56555c-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:43 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:19:43 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:44 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.773s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:44 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:19:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Deleted volume successfully. Jul 08 18:19:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46f43c8d-bb08-4563-a4fe-498dfe194c6a tempest-VolumesNegativeTest-674786742 None] Lock "cinder-78c3de3a-bb56-4544-8f19-bf6e4f218d23-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Flow 'volume_create_manager' (9876cc35-f4ac-4fb9-9808-9da91963665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c19416-d5f5-4ff1-ab12-5b7536fb2af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c19416-d5f5-4ff1-ab12-5b7536fb2af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1626142042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843b1f95-4983-41b7-b098-4b5082cc1b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbbe511fea34e918cb5775181016203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:48Z,use_quota=True,user_id='28d0751fdccf432bb072782ea2ee9779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d8a068-3366-4acd-84da-b706ed58ea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d8a068-3366-4acd-84da-b706ed58ea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7e656c-1812-49aa-aae5-8a67f9f3b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7e656c-1812-49aa-aae5-8a67f9f3b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843b1f95-4983-41b7-b098-4b5082cc1b5b', 'volume_name': 'volume-843b1f95-4983-41b7-b098-4b5082cc1b5b', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e857f240-7abd-4f16-a001-f9bc429c2aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e857f240-7abd-4f16-a001-f9bc429c2aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6012c1-5876-4ddd-ad2c-cf03c136b14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:48 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Volume 843b1f95-4983-41b7-b098-4b5082cc1b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843b1f95-4983-41b7-b098-4b5082cc1b5b', 'volume_size': 1} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1626142042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843b1f95-4983-41b7-b098-4b5082cc1b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbbe511fea34e918cb5775181016203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:48Z,use_quota=True,user_id='28d0751fdccf432bb072782ea2ee9779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Creating volume 843b1f95-4983-41b7-b098-4b5082cc1b5b {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:19:48 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:19:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:48 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b 1073741824 Jul 08 18:19:48 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:49 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b 1073741824" returned: 0 in 1.062s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:49 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b Jul 08 18:19:49 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-6312c29c-d056-431f-a78f-97f86e5dfaa9 req-773ad0b9-a286-4fc5-9259-861f6624c3b8 tempest-AttachVolumeTestJSON-700241529 None] Terminate volume connection completed successfully. Jul 08 18:19:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-6312c29c-d056-431f-a78f-97f86e5dfaa9 req-773ad0b9-a286-4fc5-9259-861f6624c3b8 tempest-AttachVolumeTestJSON-700241529 None] Deleting attachment 2d98e7ed-8f16-492f-b0a2-eebb1596a188. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:19:50 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b" returned: 0 in 0.738s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:19:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6012c1-5876-4ddd-ad2c-cf03c136b14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843b1f95-4983-41b7-b098-4b5082cc1b5b', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8053f7-614e-4d9f-b00b-d753901d9694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Volume volume-843b1f95-4983-41b7-b098-4b5082cc1b5b (843b1f95-4983-41b7-b098-4b5082cc1b5b): created successfully Jul 08 18:19:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8053f7-614e-4d9f-b00b-d753901d9694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Flow 'volume_create_manager' (9876cc35-f4ac-4fb9-9808-9da91963665e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5e739445-02a0-43ef-932d-68ee360cd21f tempest-AttachVolumeNegativeTest-1469097328 None] Created volume successfully. Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (19b1bbbd-4e7a-42f7-b6d2-7f459fdb92ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd4033a-1e78-4591-9b1d-50ddd20682d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd4033a-1e78-4591-9b1d-50ddd20682d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-80296430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844f3eb6-6d39-463c-abcc-05cbaaf721eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:51Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d9316e-0e7e-408b-8f22-d089bbf1a9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d9316e-0e7e-408b-8f22-d089bbf1a9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eb6385-ca34-4519-b791-8e5c050d7ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eb6385-ca34-4519-b791-8e5c050d7ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '844f3eb6-6d39-463c-abcc-05cbaaf721eb', 'volume_name': 'volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ec11e5-7a29-48aa-b929-0fa0b9c9048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ec11e5-7a29-48aa-b929-0fa0b9c9048c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462a295c-7db1-41d7-86e8-55a85b8bff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:51 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Volume 844f3eb6-6d39-463c-abcc-05cbaaf721eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb', 'volume_size': 1} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-80296430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844f3eb6-6d39-463c-abcc-05cbaaf721eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:51Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Creating volume 844f3eb6-6d39-463c-abcc-05cbaaf721eb {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:19:51 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:19:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:51 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb 1073741824 Jul 08 18:19:51 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-a49c94cd-05ba-4cfc-ab8c-e84fc4d55f98 req-d301e9c9-6ff4-451b-8143-6a0082694219 tempest-AttachVolumeTestJSON-700241529 None] Terminate volume connection completed successfully. Jul 08 18:19:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-a49c94cd-05ba-4cfc-ab8c-e84fc4d55f98 req-d301e9c9-6ff4-451b-8143-6a0082694219 tempest-AttachVolumeTestJSON-700241529 None] Deleting attachment f1470b5a-fad2-4a19-887a-3a38e69ce143. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:19:52 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb 1073741824" returned: 0 in 1.167s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:52 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb Jul 08 18:19:52 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:53 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb" returned: 0 in 0.885s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462a295c-7db1-41d7-86e8-55a85b8bff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4729f6-7989-40ec-9efb-7c4e70075735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:53 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Volume volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb (844f3eb6-6d39-463c-abcc-05cbaaf721eb): created successfully Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4729f6-7989-40ec-9efb-7c4e70075735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (19b1bbbd-4e7a-42f7-b6d2-7f459fdb92ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:53 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-be4a872b-8aad-442c-914b-a01c2b188a62 tempest-VolumesActionsTest-596353583 None] Created volume successfully. Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-fdef026c-9a76-41ba-b00f-d4d8c4929d3b req-702121e1-9524-40c9-93e2-fe341284afec tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-fdef026c-9a76-41ba-b00f-d4d8c4929d3b req-702121e1-9524-40c9-93e2-fe341284afec tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6275e238-7cb0-47cf-a5cb-ff11c33dad46]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:19:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-fdef026c-9a76-41ba-b00f-d4d8c4929d3b req-702121e1-9524-40c9-93e2-fe341284afec tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:53 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b Jul 08 18:19:53 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-844f3eb6-6d39-463c-abcc-05cbaaf721eb-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Lock "cinder-844f3eb6-6d39-463c-abcc-05cbaaf721eb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-quobyte-844f3eb6-6d39-463c-abcc-05cbaaf721eb" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Lock "cinder-quobyte-844f3eb6-6d39-463c-abcc-05cbaaf721eb" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e7559-2449-4719-a5f3-318103a46144]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:54 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-fdef026c-9a76-41ba-b00f-d4d8c4929d3b req-702121e1-9524-40c9-93e2-fe341284afec tempest-AttachVolumeNegativeTest-1469097328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b" returned: 0 in 1.069s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-fdef026c-9a76-41ba-b00f-d4d8c4929d3b req-702121e1-9524-40c9-93e2-fe341284afec tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-fdef026c-9a76-41ba-b00f-d4d8c4929d3b req-702121e1-9524-40c9-93e2-fe341284afec tempest-AttachVolumeNegativeTest-1469097328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-843b1f95-4983-41b7-b098-4b5082cc1b5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3a39e8f-108f-482c-9351-2414efd83526', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:19:55 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb Jul 08 18:19:55 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:55 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-fdef026c-9a76-41ba-b00f-d4d8c4929d3b req-702121e1-9524-40c9-93e2-fe341284afec tempest-AttachVolumeNegativeTest-1469097328 None] attachment_update completed successfully. Jul 08 18:19:55 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb" returned: 0 in 1.039s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:56 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb Jul 08 18:19:56 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:56 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-844f3eb6-6d39-463c-abcc-05cbaaf721eb" returned: 0 in 0.901s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Lock "cinder-quobyte-844f3eb6-6d39-463c-abcc-05cbaaf721eb" released by "delete_volume" :: held 1.990s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:56 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Created reservations ['d07c53d8-cc9e-45a1-9bfd-aa9eade608bf', '18427e24-8332-451a-9c47-82d86a009d00', '9cd2d933-13ee-47d0-90ca-980b0eb355ff', '0f915757-0666-4906-90eb-327d0176c199'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:57 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:19:57 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (b66d119c-2e85-4d3d-913b-7c28bf9e881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efa68cc-fcce-491d-95de-88a2a17a4511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efa68cc-fcce-491d-95de-88a2a17a4511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1090142095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e970c1-1e8d-40ac-a8f0-ffe3079001a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ca240eb3b4b4cab8cca5a1b6d8ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:57Z,use_quota=True,user_id='a53b620187234b7b80acd3ace96e2ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966464cf-8e71-41d3-b74d-a39d98ab27dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966464cf-8e71-41d3-b74d-a39d98ab27dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8423a7a4-5b74-4a83-bae1-175cd0b1bd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8423a7a4-5b74-4a83-bae1-175cd0b1bd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e970c1-1e8d-40ac-a8f0-ffe3079001a4', 'volume_name': 'volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ba8cad-5246-45d0-adff-4c26492d3cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ba8cad-5246-45d0-adff-4c26492d3cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a245b9bb-5b5d-4f66-9d9c-ac88607f2ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume 15e970c1-1e8d-40ac-a8f0-ffe3079001a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4', 'volume_size': 1} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1090142095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e970c1-1e8d-40ac-a8f0-ffe3079001a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ca240eb3b4b4cab8cca5a1b6d8ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:57Z,use_quota=True,user_id='a53b620187234b7b80acd3ace96e2ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Creating volume 15e970c1-1e8d-40ac-a8f0-ffe3079001a4 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:19:57 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:57 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 1073741824 Jul 08 18:19:57 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (e52c6e20-3c53-4f76-89f0-161729ae5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713c0bfe-c10b-46bf-9cab-1cd28462b3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713c0bfe-c10b-46bf-9cab-1cd28462b3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-723317149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cbad73-ca0e-4993-8f64-6a03146402a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:58Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45926a4a-0014-4c7e-86fe-c759cf952cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45926a4a-0014-4c7e-86fe-c759cf952cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bac519-c0eb-4cf6-8806-bccc4d349896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bac519-c0eb-4cf6-8806-bccc4d349896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82cbad73-ca0e-4993-8f64-6a03146402a6', 'volume_name': 'volume-82cbad73-ca0e-4993-8f64-6a03146402a6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fea4626-00c3-4f65-aa1b-0778d53da76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fea4626-00c3-4f65-aa1b-0778d53da76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df02199c-c86d-4c9b-b461-96efe00ab4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:57 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Volume 82cbad73-ca0e-4993-8f64-6a03146402a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82cbad73-ca0e-4993-8f64-6a03146402a6', 'volume_size': 1} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:57 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.851s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:19:57 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Deleted volume successfully. Jul 08 18:19:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-591c0089-1935-4870-b74b-f44a928508fa tempest-VolumesActionsTest-759292681 None] Lock "cinder-844f3eb6-6d39-463c-abcc-05cbaaf721eb-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:19:58 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 1073741824" returned: 0 in 1.002s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:58 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 Jul 08 18:19:58 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:59 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" returned: 0 in 0.694s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-723317149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cbad73-ca0e-4993-8f64-6a03146402a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:19:58Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Creating volume 82cbad73-ca0e-4993-8f64-6a03146402a6 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:19:59 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a245b9bb-5b5d-4f66-9d9c-ac88607f2ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:59 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 1073741824 Jul 08 18:19:59 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1312127-5a27-48d0-babe-77e6bd5f4535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:19:59 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 (15e970c1-1e8d-40ac-a8f0-ffe3079001a4): created successfully Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1312127-5a27-48d0-babe-77e6bd5f4535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (b66d119c-2e85-4d3d-913b-7c28bf9e881e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:19:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8b4cd380-c4e3-4082-8b18-b9102c823741 tempest-VolumesSnapshotTestJSON-1638421444 None] Created volume successfully. Jul 08 18:19:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:00 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 1073741824" returned: 0 in 0.885s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:00 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 Jul 08 18:20:00 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:00 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6" returned: 0 in 0.651s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.129s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Creating offline snapshot 56c1fd05-1342-4b3f-8f65-f510eb0ab015 of volume 15e970c1-1e8d-40ac-a8f0-ffe3079001a4 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df02199c-c86d-4c9b-b461-96efe00ab4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82cbad73-ca0e-4993-8f64-6a03146402a6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ce4731-9cad-42e7-a469-7402bcc05310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[358c127b-b2c8-4a69-b3ad-3a4a25aacbd5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:00 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Volume volume-82cbad73-ca0e-4993-8f64-6a03146402a6 (82cbad73-ca0e-4993-8f64-6a03146402a6): created successfully Jul 08 18:20:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ce4731-9cad-42e7-a469-7402bcc05310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (e52c6e20-3c53-4f76-89f0-161729ae5560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dfef94f6-7fd1-4884-a7af-4462ece413ba tempest-VolumesActionsTest-596353583 None] Created volume successfully. Jul 08 18:20:01 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 Jul 08 18:20:01 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:01 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" returned: 0 in 0.859s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-831b4f1f-7a0e-4fe2-a60d-953d7dcf56ab req-bcca6bac-6d90-437a-9c9e-55a763c5e5e2 tempest-AttachVolumeNegativeTest-1469097328 None] Terminate volume connection completed successfully. Jul 08 18:20:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-831b4f1f-7a0e-4fe2-a60d-953d7dcf56ab req-bcca6bac-6d90-437a-9c9e-55a763c5e5e2 tempest-AttachVolumeNegativeTest-1469097328 None] Deleting attachment d3a39e8f-108f-482c-9351-2414efd83526. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:20:01 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 1G Jul 08 18:20:01 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-82cbad73-ca0e-4993-8f64-6a03146402a6-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Lock "cinder-82cbad73-ca0e-4993-8f64-6a03146402a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-quobyte-82cbad73-ca0e-4993-8f64-6a03146402a6" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Lock "cinder-quobyte-82cbad73-ca0e-4993-8f64-6a03146402a6" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd385e35-9263-4a5b-b778-b39f0ff8ca46]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:02 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:02 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:02 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 Jul 08 18:20:02 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:03 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 1G" returned: 0 in 1.226s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:03 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 Jul 08 18:20:03 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:03 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.848s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:20:03 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6" returned: 0 in 1.032s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:03 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6 Jul 08 18:20:03 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "cinder-cfa4a105-c437-43ce-9b1d-18ff38737777-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-cfa4a105-c437-43ce-9b1d-18ff38737777-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:03 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "cinder-quobyte-cfa4a105-c437-43ce-9b1d-18ff38737777" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015" returned: 0 in 0.871s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:03 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 is being set with open permissions: ugo+rw Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-quobyte-cfa4a105-c437-43ce-9b1d-18ff38737777" acquired by "delete_volume" :: waited 0.038s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:03 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 Jul 08 18:20:03 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd7d852-b323-48bf-bba2-6e037ad40832]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:04 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 Jul 08 18:20:04 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:04 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82cbad73-ca0e-4993-8f64-6a03146402a6" returned: 0 in 0.803s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Lock "cinder-quobyte-82cbad73-ca0e-4993-8f64-6a03146402a6" released by "delete_volume" :: held 1.888s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Created reservations ['387fdabe-e464-47b9-8ec4-defe3dc457d9', '5fd4d3b2-3b2f-483a-91c7-81370ea98790', '33972c62-5c1d-48a3-9d9a-a96c8bd04cd3', 'af0cc710-eb52-48c3-8bd1-42af5a14207e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:04 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:04 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:04 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015" returned: 0 in 0.760s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:04 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.info Jul 08 18:20:04 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:04 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777" returned: 0 in 0.908s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:04 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777 Jul 08 18:20:04 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:05 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (025fbd77-3f6b-4dc3-bee5-2500a45459a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d40454-7b75-4434-9555-4120c68fc8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.908s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d40454-7b75-4434-9555-4120c68fc8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-277199082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ae54a9-382f-4a4c-a2ed-453a1b2f88d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:05Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ec3346-4cd6-421e-8565-8942753c1aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ec3346-4cd6-421e-8565-8942753c1aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741d11f9-bd7f-48ec-8691-99312df44893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741d11f9-bd7f-48ec-8691-99312df44893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ae54a9-382f-4a4c-a2ed-453a1b2f88d5', 'volume_name': 'volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e278d1e-eca7-48d6-9efe-5d045116ea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e278d1e-eca7-48d6-9efe-5d045116ea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2390690a-5254-4bc4-8581-569d3d1f8b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Volume 84ae54a9-382f-4a4c-a2ed-453a1b2f88d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5', 'volume_size': 1} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:05 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Deleted volume successfully. Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58fb2606-dce8-47ea-a6bc-3d8f461e8975 tempest-VolumesActionsTest-759292681 None] Lock "cinder-82cbad73-ca0e-4993-8f64-6a03146402a6-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:05 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.info" returned: 0 in 0.749s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:05 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.info is being set with open permissions: ugo+rw Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:05 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.info Jul 08 18:20:05 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:05 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfa4a105-c437-43ce-9b1d-18ff38737777" returned: 0 in 0.801s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-quobyte-cfa4a105-c437-43ce-9b1d-18ff38737777" released by "delete_volume" :: held 1.767s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Created reservations ['5449a8e2-3903-4605-be80-95c1ae4b8737', '8f331e99-27ca-47be-81df-83551c054953', '50a4d125-5dcc-4d45-972f-9bb0eeaae258', 'eafb0933-1a3f-4122-b45e-63283b3f6a38'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:05 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:05 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "cinder-fd25d325-03b0-4697-9949-fc735c80952b-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-fd25d325-03b0-4697-9949-fc735c80952b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "cinder-quobyte-fd25d325-03b0-4697-9949-fc735c80952b" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-quobyte-fd25d325-03b0-4697-9949-fc735c80952b" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:06 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.info" returned: 0 in 0.850s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.432s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2f1f95-5336-4ca1-b37e-3bae33fee46a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-277199082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ae54a9-382f-4a4c-a2ed-453a1b2f88d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:05Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Creating volume 84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:06 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:06 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 1073741824 Jul 08 18:20:06 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-cff08961-5b9f-45c2-8605-4a9e1705a8bb tempest-VolumesSnapshotTestJSON-1638421444 None] Create snapshot completed successfully Jul 08 18:20:06 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b Jul 08 18:20:06 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:06 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.825s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Deleted volume successfully. Jul 08 18:20:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7a90b0b-9dcc-4098-9f3c-a12a862d6007 tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-cfa4a105-c437-43ce-9b1d-18ff38737777-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:07 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b" returned: 0 in 1.039s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:07 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b Jul 08 18:20:07 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-56c1fd05-1342-4b3f-8f65-f510eb0ab015-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-56c1fd05-1342-4b3f-8f65-f510eb0ab015-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:07 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-56c1fd05-1342-4b3f-8f65-f510eb0ab015" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 1073741824" returned: 0 in 1.191s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-56c1fd05-1342-4b3f-8f65-f510eb0ab015" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Deleting offline snapshot 56c1fd05-1342-4b3f-8f65-f510eb0ab015 of volume 15e970c1-1e8d-40ac-a8f0-ffe3079001a4 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] snapshot_file for this snap is: volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e844e9-02a1-478d-8cd9-23e317661249]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:07 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 Jul 08 18:20:07 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:07 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 Jul 08 18:20:07 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:08 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fd25d325-03b0-4697-9949-fc735c80952b" returned: 0 in 0.778s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-quobyte-fd25d325-03b0-4697-9949-fc735c80952b" released by "delete_volume" :: held 1.930s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Created reservations ['fb746d75-3f97-45cc-ba20-ac35c7d9f1bf', '47f30410-9c92-4444-9589-8443380e39f5', '8cbe377b-0cad-443c-a37a-d4521983454f', 'e8ae59f5-4688-4400-b27b-027c680691bd'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:08 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5" returned: 0 in 0.745s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2390690a-5254-4bc4-8581-569d3d1f8b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:08 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:08 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ebd98a-7cb8-4f5d-b65d-3afb538fb663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:08 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Volume volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 (84ae54a9-382f-4a4c-a2ed-453a1b2f88d5): created successfully Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ebd98a-7cb8-4f5d-b65d-3afb538fb663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (025fbd77-3f6b-4dc3-bee5-2500a45459a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:08 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-740a9b2e-5a68-4e39-b547-b4bb30a0ad46 tempest-VolumesActionsTest-596353583 None] Created volume successfully. Jul 08 18:20:08 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015" returned: 0 in 0.927s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1e05eb-4a3d-4417-9a6a-25db444e7fca]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "cinder-41181d52-8cbc-40a3-ba28-7c50e107307c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-41181d52-8cbc-40a3-ba28-7c50e107307c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "cinder-quobyte-41181d52-8cbc-40a3-ba28-7c50e107307c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-quobyte-41181d52-8cbc-40a3-ba28-7c50e107307c" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:08 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 Jul 08 18:20:08 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b13a1-9aee-432c-87f6-06039e88ae5a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:08 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c Jul 08 18:20:08 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:09 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.747s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Deleted volume successfully. Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d4b52d98-6393-4947-aff0-2bd4e212dc5b tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-fd25d325-03b0-4697-9949-fc735c80952b-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:09 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" returned: 0 in 0.830s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:09 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 Jul 08 18:20:09 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:09 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c" returned: 0 in 0.867s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:09 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c Jul 08 18:20:09 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Lock "cinder-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-quobyte-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Lock "cinder-quobyte-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b359d636-d2ff-4e4d-ae50-88f9d4355fdb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:09 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 Jul 08 18:20:09 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:10 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015" returned: 0 in 0.775s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:10 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015 Jul 08 18:20:10 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:10 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-41181d52-8cbc-40a3-ba28-7c50e107307c" returned: 0 in 0.744s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-quobyte-41181d52-8cbc-40a3-ba28-7c50e107307c" released by "delete_volume" :: held 1.658s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Created reservations ['402a2e97-5c17-4357-9b9c-bc4c2bf2ddbb', '59566788-548c-4458-85e4-f830f09da018', '3443001c-a8e8-48df-842a-0c15f08c4db4', '4c4de63b-b4d4-4167-84f2-7860c7fb5bb6'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=74,cinder:SELECT=86,cinder:INSERT=20,cinder:DELETE=10 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=91,cinder:UPDATE=103,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:10 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:10 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:10 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5" returned: 0 in 0.865s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:10 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5 Jul 08 18:20:10 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:10 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4.56c1fd05-1342-4b3f-8f65-f510eb0ab015" returned: 0 in 0.735s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-56c1fd05-1342-4b3f-8f65-f510eb0ab015" released by "_delete_snapshot" :: held 3.398s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" released by "delete_snapshot" :: held 3.432s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Created reservations ['cf3d7ddc-19cb-4856-9145-2e302d78c1d3', 'f3566b7a-8b8e-4101-922c-37ebcb0b41ea', 'e34b8c73-fab3-43aa-9d68-6f229bbe3352', '9d21d858-8829-4e7a-80ba-8fb2280d71dd'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Delete snapshot completed successfully. Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9e2d81d2-146a-49b8-a9bb-1c9018eb60ed tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-56c1fd05-1342-4b3f-8f65-f510eb0ab015-delete_snapshot" released by "delete_snapshot" :: held 3.695s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:11 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.695s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Deleted volume successfully. Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-480dff19-c0d9-4302-84b7-e9dfa00e19a0 tempest-AttachVolumeTestJSON-700241529 None] Lock "cinder-41181d52-8cbc-40a3-ba28-7c50e107307c-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:11 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5" returned: 0 in 0.828s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Lock "cinder-quobyte-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5" released by "delete_volume" :: held 1.753s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Created reservations ['0abb7f20-f41b-49fc-b069-e127c4fd660d', 'c61cb341-e5f8-41cc-a383-2b4d7369a2de', '264973d6-2a53-449c-8db8-8c740fc43f75', 'ff3dcfb5-91a0-43b7-8cf5-77d98e4b283a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:11 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:11 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:12 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.804s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:12 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Deleted volume successfully. Jul 08 18:20:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c079d4ef-ff07-4c47-922a-5d5ef05c23b7 tempest-VolumesActionsTest-759292681 None] Lock "cinder-84ae54a9-382f-4a4c-a2ed-453a1b2f88d5-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:12 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (7a58d90f-ac51-4ad0-b665-df4543a39ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c04deb1-252b-4177-a6f2-eba76989a01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c04deb1-252b-4177-a6f2-eba76989a01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-711244518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3c0f54-131b-4fe3-b73b-9fd42d42ed02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ca240eb3b4b4cab8cca5a1b6d8ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:13Z,use_quota=True,user_id='a53b620187234b7b80acd3ace96e2ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930e56a2-3a04-4f7c-81dc-b66d7c2ba047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930e56a2-3a04-4f7c-81dc-b66d7c2ba047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035d1899-ff1f-4d22-abc0-757af9aa7943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035d1899-ff1f-4d22-abc0-757af9aa7943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3c0f54-131b-4fe3-b73b-9fd42d42ed02', 'volume_name': 'volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09774a8-0058-4d25-8b4d-1c0b2aaf9062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09774a8-0058-4d25-8b4d-1c0b2aaf9062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b704ec-7ab5-493f-9629-439599e05b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Volume 9c3c0f54-131b-4fe3-b73b-9fd42d42ed02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02', 'volume_size': 1} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-711244518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3c0f54-131b-4fe3-b73b-9fd42d42ed02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ca240eb3b4b4cab8cca5a1b6d8ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:13Z,use_quota=True,user_id='a53b620187234b7b80acd3ace96e2ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Creating volume 9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:13 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:13 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 1073741824 Jul 08 18:20:13 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (9c667845-9a76-410f-aeea-391fdcdace67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f87e192-7207-4535-ae26-1c4776144f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f87e192-7207-4535-ae26-1c4776144f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1149582152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:13Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07477feb-e2c3-4040-8d87-9bef02ff8e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07477feb-e2c3-4040-8d87-9bef02ff8e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c7809-8f9b-476a-8b01-40cda6055fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c7809-8f9b-476a-8b01-40cda6055fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad', 'volume_name': 'volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb2f536-dfb2-4c3a-b248-a23096193301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb2f536-dfb2-4c3a-b248-a23096193301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba559df2-56f2-4306-9b78-5e4a0b58cd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:13 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Volume f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad', 'volume_size': 1} Jul 08 18:20:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:14 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 1073741824" returned: 0 in 1.033s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:14 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 Jul 08 18:20:14 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:14 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" returned: 0 in 0.769s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1149582152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:13Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Creating volume f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:14 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:14 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad 1073741824 Jul 08 18:20:14 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b704ec-7ab5-493f-9629-439599e05b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc97a69b-d3a6-4e53-a6b5-f9944251fe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:15 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Volume volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 (9c3c0f54-131b-4fe3-b73b-9fd42d42ed02): created successfully Jul 08 18:20:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc97a69b-d3a6-4e53-a6b5-f9944251fe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (7a58d90f-ac51-4ad0-b665-df4543a39ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4f11ab76-95df-4754-8a37-97b2a5a179db tempest-VolumesSnapshotTestJSON-1638421444 None] Created volume successfully. Jul 08 18:20:16 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad 1073741824" returned: 0 in 1.073s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:16 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad Jul 08 18:20:16 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:16 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad" returned: 0 in 0.785s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.698s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Creating offline snapshot ce22144a-4534-4fe6-ad56-faf25e72b4f8 of volume 9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba559df2-56f2-4306-9b78-5e4a0b58cd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a59207-4c79-4ba3-b750-f2bda350cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aecc40-20f7-449e-b06e-9bf0e771bcca]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:16 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Volume volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad (f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad): created successfully Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a59207-4c79-4ba3-b750-f2bda350cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (9c667845-9a76-410f-aeea-391fdcdace67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:16 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5a3c8ffb-a53d-47af-9722-bccebe8fcdbf tempest-VolumesActionsTest-596353583 None] Created volume successfully. Jul 08 18:20:17 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 Jul 08 18:20:17 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Lock "cinder-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Acquiring lock "cinder-quobyte-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Lock "cinder-quobyte-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:17 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6896231-7200-4770-b379-bb71a76f0284]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:17 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad Jul 08 18:20:17 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:17 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" returned: 0 in 1.060s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:17 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 1G Jul 08 18:20:17 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:18 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad" returned: 0 in 0.876s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:18 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad Jul 08 18:20:18 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:18 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 1G" returned: 0 in 0.925s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:18 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 Jul 08 18:20:18 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:18 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad" returned: 0 in 0.704s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:18 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Lock "cinder-quobyte-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad" released by "delete_volume" :: held 1.630s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Created reservations ['2f8d7146-5dd0-47c6-9ad2-683c08091a41', '44ac9506-0d02-413c-8903-2655c4562f03', 'ef5f4d09-b854-4992-8134-6b3907817f33', 'ba8743cd-b85b-4036-8aa2-5893c76eb388'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:19 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:19 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:19 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:19 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 is being set with open permissions: ugo+rw Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:19 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 Jul 08 18:20:19 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:19 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.712s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:19 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Deleted volume successfully. Jul 08 18:20:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bddcd932-b630-40a6-a1fe-29bcbb145a43 tempest-VolumesActionsTest-759292681 None] Lock "cinder-f86ba6e0-0990-40a4-adc3-4f6d0b10e5ad-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (152c7313-5319-4b66-95a9-b9993594d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de92c6ed-456a-450d-8f42-02cf0f36b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de92c6ed-456a-450d-8f42-02cf0f36b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2097150310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d97645-928d-49e7-9b00-da00d5dcccb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:20Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3415fe5-daa2-46bd-ac60-e04595ad8f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3415fe5-daa2-46bd-ac60-e04595ad8f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15a38f0-188e-4cac-8c66-c1a3f3be3e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15a38f0-188e-4cac-8c66-c1a3f3be3e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d97645-928d-49e7-9b00-da00d5dcccb7', 'volume_name': 'volume-53d97645-928d-49e7-9b00-da00d5dcccb7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f7a1f1-2717-401f-b97e-a2dca8e1da9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f7a1f1-2717-401f-b97e-a2dca8e1da9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c62f35-181e-4ff7-abf1-5c8e294a6475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:20 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Volume 53d97645-928d-49e7-9b00-da00d5dcccb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d97645-928d-49e7-9b00-da00d5dcccb7', 'volume_size': 1} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:20 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8" returned: 0 in 0.778s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:20 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.info Jul 08 18:20:20 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:21 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.info" returned: 0 in 0.679s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:21 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.info is being set with open permissions: ugo+rw Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:21 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.info Jul 08 18:20:21 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:21 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.info" returned: 0 in 0.712s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.081s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.712s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2097150310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d97645-928d-49e7-9b00-da00d5dcccb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a18b2fe4b84443c6b37adeacd8c5b0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:20Z,use_quota=True,user_id='e30fd80c9d324892a0277b9f846d85e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Creating volume 53d97645-928d-49e7-9b00-da00d5dcccb7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:21 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:21 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 1073741824 Jul 08 18:20:21 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:22 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e141e8e4-7295-4add-bdb9-3b474906ff3d tempest-VolumesSnapshotTestJSON-1638421444 None] Create snapshot completed successfully Jul 08 18:20:23 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 1073741824" returned: 0 in 1.192s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:23 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 Jul 08 18:20:23 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (b28704db-4fbb-415b-ba36-6d0fa5168372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128ef278-adf8-49d4-93d8-796ece85ac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128ef278-adf8-49d4-93d8-796ece85ac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1415108398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f575c74-99c5-4820-9d58-559d6101a003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ca240eb3b4b4cab8cca5a1b6d8ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ce22144a-4534-4fe6-ad56-faf25e72b4f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:23Z,use_quota=True,user_id='a53b620187234b7b80acd3ace96e2ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7da6bae-9bc3-4fa5-add9-00d19c45c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7da6bae-9bc3-4fa5-add9-00d19c45c841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4310e3-0589-4f15-9561-8c8978e0f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4310e3-0589-4f15-9561-8c8978e0f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f575c74-99c5-4820-9d58-559d6101a003', 'volume_name': 'volume-7f575c74-99c5-4820-9d58-559d6101a003', 'volume_size': 2, 'snapshot_id': 'ce22144a-4534-4fe6-ad56-faf25e72b4f8'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4227793e-14a6-45f4-b2c9-97e06d517398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4227793e-14a6-45f4-b2c9-97e06d517398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6546a56-8a7e-4d18-a6a4-b72e86474bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:23 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Volume 7f575c74-99c5-4820-9d58-559d6101a003: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f575c74-99c5-4820-9d58-559d6101a003', 'volume_size': 2, 'snapshot_id': 'ce22144a-4534-4fe6-ad56-faf25e72b4f8'} Jul 08 18:20:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:24 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5fff5a0b-b40d-4a46-b671-ae3068eca0f3 tempest-GroupSnapshotsV319Test-1828771685 None] Group tempest-GroupSnapshotsV319Test-Group-749240518: creating Jul 08 18:20:24 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5fff5a0b-b40d-4a46-b671-ae3068eca0f3 tempest-GroupSnapshotsV319Test-1828771685 None] Group tempest-GroupSnapshotsV319Test-Group-749240518: created successfully Jul 08 18:20:24 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5fff5a0b-b40d-4a46-b671-ae3068eca0f3 tempest-GroupSnapshotsV319Test-1828771685 None] Create group completed successfully. Jul 08 18:20:24 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7" returned: 0 in 0.943s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.638s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-ce22144a-4534-4fe6-ad56-faf25e72b4f8-7f575c74-99c5-4820-9d58-559d6101a003" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c62f35-181e-4ff7-abf1-5c8e294a6475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d97645-928d-49e7-9b00-da00d5dcccb7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7202cff-df62-4c1c-91b8-eb1350774a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-ce22144a-4534-4fe6-ad56-faf25e72b4f8-7f575c74-99c5-4820-9d58-559d6101a003" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Creating volume 7f575c74-99c5-4820-9d58-559d6101a003 from snapshot ce22144a-4534-4fe6-ad56-faf25e72b4f8 {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-7f575c74-99c5-4820-9d58-559d6101a003" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:24 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Volume volume-53d97645-928d-49e7-9b00-da00d5dcccb7 (53d97645-928d-49e7-9b00-da00d5dcccb7): created successfully Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7202cff-df62-4c1c-91b8-eb1350774a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Flow 'volume_create_manager' (152c7313-5319-4b66-95a9-b9993594d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-7f575c74-99c5-4820-9d58-559d6101a003" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] snapshot: ce22144a-4534-4fe6-ad56-faf25e72b4f8, volume: 7f575c74-99c5-4820-9d58-559d6101a003, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:20:24 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-606b2539-4b08-43ad-b6e9-feffaaa6e530 tempest-VolumesActionsTest-596353583 None] Created volume successfully. Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1087ab-b3e4-4dd3-89e9-0d001ecf1589]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:24 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 Jul 08 18:20:24 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Acquiring lock "cinder-53d97645-928d-49e7-9b00-da00d5dcccb7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Lock "cinder-53d97645-928d-49e7-9b00-da00d5dcccb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Acquiring lock "cinder-quobyte-53d97645-928d-49e7-9b00-da00d5dcccb7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Lock "cinder-quobyte-53d97645-928d-49e7-9b00-da00d5dcccb7" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:25 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8" returned: 0 in 0.836s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31c1f95-a3e0-42f7-bbe4-8b5ddb2ee02f]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a08cf-0a92-4758-888c-b275dad7b09b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:25 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 Jul 08 18:20:25 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:25 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 Jul 08 18:20:25 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Flow 'volume_create_manager' (a0e42bf2-681a-4ead-a707-b68a623e5cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9cc2c6-9c29-4582-92a2-a60e426ba37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9cc2c6-9c29-4582-92a2-a60e426ba37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-574765815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65d9ec4b-8233-4361-9884-329d065d200b,host='devstack@QuobyteHD#QuobyteHD',id=f659d96a-d2ce-4d3a-b8d0-1949a3612b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36208daf44c641f39cb2e59215e2179e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:26Z,use_quota=True,user_id='89a6b434fe1e42b196e40435d1777e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bcf0b68-9c32-4a71-8070-0292bc23b129),volume_type_id=6bcf0b68-9c32-4a71-8070-0292bc23b129)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38cd8dc-561b-4ff6-ab98-c159845d4886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38cd8dc-561b-4ff6-ab98-c159845d4886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25044603-084b-4f54-9c84-6370b5390965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25044603-084b-4f54-9c84-6370b5390965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f659d96a-d2ce-4d3a-b8d0-1949a3612b7b', 'volume_name': 'volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af2091d-c2e0-4a3a-a263-99ba3beef767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af2091d-c2e0-4a3a-a263-99ba3beef767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53656e38-efde-4af0-99e5-9a35af30e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:25 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Volume f659d96a-d2ce-4d3a-b8d0-1949a3612b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b', 'volume_size': 1} Jul 08 18:20:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:26 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" returned: 0 in 0.914s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:26 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:20:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:26 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 Jul 08 18:20:26 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:26 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7" returned: 0 in 1.058s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:26 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7 Jul 08 18:20:26 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:26 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-53d97645-928d-49e7-9b00-da00d5dcccb7" returned: 0 in 0.730s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Lock "cinder-quobyte-53d97645-928d-49e7-9b00-da00d5dcccb7" released by "delete_volume" :: held 1.838s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:27 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Created reservations ['21c419a3-5890-4847-870e-e70c4b5d7d6b', 'df9e807b-0820-4c1c-b15f-c366c1f04228', '5d85d6ac-1ec3-4b5e-b5d1-6ff6ce408567', '179dc6dd-87ef-4f01-995c-11c71d6215c3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:27 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:27 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:28 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.608s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:28 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Deleted volume successfully. Jul 08 18:20:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a203d5ec-2ac7-4539-84be-ba70d69f8ccf tempest-VolumesActionsTest-596353583 None] Lock "cinder-53d97645-928d-49e7-9b00-da00d5dcccb7-delete_volume" released by "delete_volume" :: held 3.872s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003" returned: 0 in 7.257s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab78158-c03c-4c75-ba94-febaa1f05d08]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:33 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 Jul 08 18:20:33 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:34 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" returned: 0 in 1.232s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:34 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:20:34 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Converted 1024.00 MB image at 141.08 MB/s Jul 08 18:20:34 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 is being set with open permissions: ugo+rw Jul 08 18:20:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:34 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 Jul 08 18:20:34 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:35 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003" returned: 0 in 1.097s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-7f575c74-99c5-4820-9d58-559d6101a003" released by "_copy_volume_from_snapshot" :: held 11.485s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-ce22144a-4534-4fe6-ad56-faf25e72b4f8-7f575c74-99c5-4820-9d58-559d6101a003" released by "_create_volume_from_snapshot" :: held 11.554s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.587s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.811s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=65d9ec4b-8233-4361-9884-329d065d200b,created_at=2026-07-08T16:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-574765815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65d9ec4b-8233-4361-9884-329d065d200b,host='devstack@QuobyteHD#QuobyteHD',id=f659d96a-d2ce-4d3a-b8d0-1949a3612b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36208daf44c641f39cb2e59215e2179e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:26Z,use_quota=True,user_id='89a6b434fe1e42b196e40435d1777e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bcf0b68-9c32-4a71-8070-0292bc23b129),volume_type_id=6bcf0b68-9c32-4a71-8070-0292bc23b129)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Creating volume f659d96a-d2ce-4d3a-b8d0-1949a3612b7b {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:35 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:35 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b 1073741824 Jul 08 18:20:35 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6546a56-8a7e-4d18-a6a4-b72e86474bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f575c74-99c5-4820-9d58-559d6101a003', 'volume_size': 2, 'snapshot_id': 'ce22144a-4534-4fe6-ad56-faf25e72b4f8'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15edc460-6edf-4b90-83fa-fe8c23812139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:35 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Volume volume-7f575c74-99c5-4820-9d58-559d6101a003 (7f575c74-99c5-4820-9d58-559d6101a003): created successfully Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15edc460-6edf-4b90-83fa-fe8c23812139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (b28704db-4fbb-415b-ba36-6d0fa5168372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-43062c5f-9abf-489a-9968-5d8b4ec2870e tempest-VolumesSnapshotTestJSON-1638421444 None] Created volume successfully. Jul 08 18:20:37 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b 1073741824" returned: 0 in 1.366s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-7f575c74-99c5-4820-9d58-559d6101a003-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-7f575c74-99c5-4820-9d58-559d6101a003-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-7f575c74-99c5-4820-9d58-559d6101a003" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:37 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b Jul 08 18:20:37 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-7f575c74-99c5-4820-9d58-559d6101a003" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:37 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d7ef8-8e30-4da1-bab9-1e0c6fca198c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:37 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 Jul 08 18:20:37 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:38 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" returned: 0 in 0.798s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53656e38-efde-4af0-99e5-9a35af30e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e43c17-a112-4622-a7f9-68bf4dbc2471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Volume volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b (f659d96a-d2ce-4d3a-b8d0-1949a3612b7b): created successfully Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e43c17-a112-4622-a7f9-68bf4dbc2471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Flow 'volume_create_manager' (a0e42bf2-681a-4ead-a707-b68a623e5cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b21a1e20-c20f-4c06-a4e1-c3a7020d7151 tempest-GroupSnapshotsV319Test-1828771685 None] Created volume successfully. Jul 08 18:20:38 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003" returned: 0 in 1.098s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:38 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003 Jul 08 18:20:38 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] GroupSnapshot ef673be3-23f0-46fa-8b93-dcd62c60cd32: creating. Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Group snapshot ef673be3-23f0-46fa-8b93-dcd62c60cd32: creating. {{(pid=87309) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Creating offline snapshot 0b51cfe6-be2e-4341-8786-33ccb9e41a6f of volume f659d96a-d2ce-4d3a-b8d0-1949a3612b7b {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc0156f-9fcd-4284-be6c-480ab96fd57c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:39 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b Jul 08 18:20:39 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:39 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7f575c74-99c5-4820-9d58-559d6101a003" returned: 0 in 0.819s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-7f575c74-99c5-4820-9d58-559d6101a003" released by "delete_volume" :: held 1.983s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Created reservations ['49a532a2-c8ee-4622-b788-3d0fb42b18bc', '004ab15d-3fc8-4cdd-a503-d7acc7433d2d', 'f0303882-adda-480f-bbca-936028622106', '4a93b0a1-fc11-4d6e-a907-a9dc09086ac2'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:39 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:39 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:40 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" returned: 0 in 1.274s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:40 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f 1G Jul 08 18:20:40 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:40 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.091s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Deleted volume successfully. Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-120d8290-48ea-449b-8b5d-edfcbd44f57a tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-7f575c74-99c5-4820-9d58-559d6101a003-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-ce22144a-4534-4fe6-ad56-faf25e72b4f8-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-ce22144a-4534-4fe6-ad56-faf25e72b4f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-ce22144a-4534-4fe6-ad56-faf25e72b4f8" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-ce22144a-4534-4fe6-ad56-faf25e72b4f8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Deleting offline snapshot ce22144a-4534-4fe6-ad56-faf25e72b4f8 of volume 9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] snapshot_file for this snap is: volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e50f314-9fff-4eb9-af46-ce1bb53f1969]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:40 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 Jul 08 18:20:40 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:41 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f 1G" returned: 0 in 1.180s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:41 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f Jul 08 18:20:41 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:41 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8" returned: 0 in 0.961s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:20:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a07694-a622-4490-b95f-40f9be8b9156]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:41 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 Jul 08 18:20:41 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:42 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f" returned: 0 in 0.868s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:42 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:20:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:42 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f Jul 08 18:20:42 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:42 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f" returned: 0 in 0.793s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:42 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" returned: 0 in 1.152s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:43 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 Jul 08 18:20:43 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:43 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.info Jul 08 18:20:43 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:43 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.info" returned: 0 in 0.829s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:43 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:20:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:43 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.info Jul 08 18:20:43 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:43 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8" returned: 0 in 0.983s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:43 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8 Jul 08 18:20:44 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:44 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.info" returned: 0 in 0.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.788s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-60e3e9ed-9bea-47e8-be7d-86ba1c84ef11 tempest-GroupSnapshotsV319Test-1828771685 None] group_snapshot ef673be3-23f0-46fa-8b93-dcd62c60cd32: created successfully Jul 08 18:20:44 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02.ce22144a-4534-4fe6-ad56-faf25e72b4f8" returned: 0 in 0.722s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-ce22144a-4534-4fe6-ad56-faf25e72b4f8" released by "_delete_snapshot" :: held 3.946s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" released by "delete_snapshot" :: held 3.986s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:44 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Created reservations ['5d13c302-8dde-4d93-aa71-dbe88cf3e20a', 'cecbe092-e03a-47ef-a50d-4c637e1ef5cb', 'b2536800-dff0-4570-ba2c-e6bdc638b943', '9efde1b8-766c-446b-9860-ac38524f81af'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Delete snapshot completed successfully. Jul 08 18:20:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-00d9f1aa-9d63-4027-96dc-19a4d22fa934 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-ce22144a-4534-4fe6-ad56-faf25e72b4f8-delete_snapshot" released by "delete_snapshot" :: held 4.141s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b032cac-81b4-4587-b02c-3b4b2a858b11]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:45 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 Jul 08 18:20:45 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] group_snapshot ef673be3-23f0-46fa-8b93-dcd62c60cd32: deleting Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] group_snapshot ef673be3-23f0-46fa-8b93-dcd62c60cd32: deleting {{(pid=87309) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Acquiring lock "cinder-quobyte-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Lock "cinder-quobyte-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Acquiring lock "cinder-quobyte-0b51cfe6-be2e-4341-8786-33ccb9e41a6f" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Lock "cinder-quobyte-0b51cfe6-be2e-4341-8786-33ccb9e41a6f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Deleting offline snapshot 0b51cfe6-be2e-4341-8786-33ccb9e41a6f of volume f659d96a-d2ce-4d3a-b8d0-1949a3612b7b {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] snapshot_file for this snap is: volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ab555c-9c6c-4752-954a-918e6c99bd71]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:45 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f Jul 08 18:20:45 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:46 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" returned: 0 in 0.824s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:46 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02 Jul 08 18:20:46 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Flow 'volume_create_manager' (6423a225-f2ef-4b8d-9f33-c5c1db669766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e81b36-621e-49ee-a9b3-a564fa2df9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e81b36-621e-49ee-a9b3-a564fa2df9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-211672729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edac1b2781bf4d3599dd5c48ace72513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:46Z,use_quota=True,user_id='cb0eee38032c4f468b48d23f16c90289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70eb537-c814-40a0-bee7-3bf662812327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70eb537-c814-40a0-bee7-3bf662812327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0e09f5-53b7-419d-b911-a3cfd88a3c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0e09f5-53b7-419d-b911-a3cfd88a3c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7', 'volume_name': 'volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ca05e3-e98e-4750-a7ff-75c9512eac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ca05e3-e98e-4750-a7ff-75c9512eac6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dd7e91-7ddf-4ed5-8d17-554081aefc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:46 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Volume dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7', 'volume_size': 1} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-211672729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edac1b2781bf4d3599dd5c48ace72513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:46Z,use_quota=True,user_id='cb0eee38032c4f468b48d23f16c90289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Creating volume dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:46 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:46 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 1073741824 Jul 08 18:20:46 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:46 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f" returned: 0 in 0.870s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b4800-200f-44b1-a3eb-69171cc21f74]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:46 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" returned: 0 in 0.671s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02" released by "delete_volume" :: held 1.568s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Created reservations ['6549fd16-3670-4ee8-991e-947e6830ad50', 'a6668f3e-a9d6-419e-ad5c-9a1ab5eca75d', 'eaf4c1cd-9afd-4ce8-9524-2335aeb7d3e1', '323bb527-c749-41f8-9e75-53cf9e640974'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:46 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b Jul 08 18:20:46 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:46 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:46 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:47 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 1073741824" returned: 0 in 0.912s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:47 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 Jul 08 18:20:47 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:47 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" returned: 0 in 0.838s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:47 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f Jul 08 18:20:47 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:47 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.818s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:47 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Deleted volume successfully. Jul 08 18:20:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f02ad124-0de4-447b-a2f7-6117d1342070 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-9c3c0f54-131b-4fe3-b73b-9fd42d42ed02-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (6164151a-69a7-417d-abb9-f1ebaadaf463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6ffc44-30bd-4704-84c7-1f2e11800c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6ffc44-30bd-4704-84c7-1f2e11800c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1323085580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c808c2-6301-4d01-9fd5-ee94c4b64c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ca240eb3b4b4cab8cca5a1b6d8ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:48Z,use_quota=True,user_id='a53b620187234b7b80acd3ace96e2ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15982417-43d5-42ed-9d60-0fc0cebdddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15982417-43d5-42ed-9d60-0fc0cebdddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94954976-ba5b-4bfa-aae8-d54f7c7fead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94954976-ba5b-4bfa-aae8-d54f7c7fead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c808c2-6301-4d01-9fd5-ee94c4b64c0f', 'volume_name': 'volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7351be-7d51-461c-a4e0-f0000e58827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7351be-7d51-461c-a4e0-f0000e58827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec5d8f6-1cde-4bee-945f-ac4b06890204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:48 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume c6c808c2-6301-4d01-9fd5-ee94c4b64c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f', 'volume_size': 1} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:48 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7" returned: 0 in 0.785s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.107s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1323085580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c808c2-6301-4d01-9fd5-ee94c4b64c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ca240eb3b4b4cab8cca5a1b6d8ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:48Z,use_quota=True,user_id='a53b620187234b7b80acd3ace96e2ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Creating volume c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:48 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:48 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f 1073741824 Jul 08 18:20:48 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4dd7e91-7ddf-4ed5-8d17-554081aefc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d8c1f4-8841-4ee0-87c7-e1254d942f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:48 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Volume volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 (dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7): created successfully Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d8c1f4-8841-4ee0-87c7-e1254d942f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Flow 'volume_create_manager' (6423a225-f2ef-4b8d-9f33-c5c1db669766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:48 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3ac931f8-c3a5-4a9b-981a-af6c3eab49a6 tempest-AbsoluteLimitsTests-1451883685 None] Created volume successfully. Jul 08 18:20:48 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f" returned: 0 in 0.885s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:48 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f Jul 08 18:20:48 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Acquiring lock "cinder-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Lock "cinder-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Acquiring lock "cinder-quobyte-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Lock "cinder-quobyte-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8959789-5991-411e-86d9-1e569fb173bc]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:48 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 Jul 08 18:20:48 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:49 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f 1073741824" returned: 0 in 0.866s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:49 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b.0b51cfe6-be2e-4341-8786-33ccb9e41a6f" returned: 0 in 0.752s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:49 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f Jul 08 18:20:49 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Lock "cinder-quobyte-0b51cfe6-be2e-4341-8786-33ccb9e41a6f" released by "_delete_snapshot" :: held 3.458s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Lock "cinder-quobyte-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" released by "delete_snapshot" :: held 3.482s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:49 devstack cinder-volume[87309]: WARNING cinder.quota [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-445306673 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-445306673, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:20:49 devstack cinder-volume[87309]: WARNING cinder.quota [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-445306673 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-445306673, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] Created reservations ['7f16abeb-4c61-4829-ba5a-81c0ff009677', '38f6a3d5-3be3-4993-90a5-eb5688a6f2d7', 'd6639d66-337a-49ea-934b-a7e36f5d7ef5', 'd82e1ec1-228b-4794-900e-608d0be291af'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0422a851-611a-4022-b959-64c6e4a2636a tempest-GroupSnapshotsV319Test-1828771685 None] group_snapshot ef673be3-23f0-46fa-8b93-dcd62c60cd32: deleted successfully Jul 08 18:20:49 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7" returned: 0 in 0.787s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:49 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7 Jul 08 18:20:49 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:49 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" returned: 0 in 0.702s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec5d8f6-1cde-4bee-945f-ac4b06890204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db583e9-9431-4241-9bc7-8663d0b5841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:49 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f (c6c808c2-6301-4d01-9fd5-ee94c4b64c0f): created successfully Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db583e9-9431-4241-9bc7-8663d0b5841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (6164151a-69a7-417d-abb9-f1ebaadaf463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d5dcd10f-e4cd-4da6-9c00-ba6a3baaeba4 tempest-VolumesSnapshotTestJSON-1638421444 None] Created volume successfully. Jul 08 18:20:50 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7" returned: 0 in 0.793s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Lock "cinder-quobyte-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7" released by "delete_volume" :: held 1.624s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Creating offline snapshot 1a6feae3-f3eb-482a-8e90-e52ef43e4d85 of volume c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba432b8-7b69-418a-9edc-1c3f3b532422]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Acquiring lock "cinder-quobyte-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Created reservations ['d77d2e5f-82aa-48f9-b4bd-7b7bd1269897', '0c8b9558-0a0d-4f73-b916-dcc5dd824d45', 'bd56cc2c-1540-416b-b8b7-2abff5e1837a', 'de45a8f5-fcbe-4aa1-b322-2ed06f70387d'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Lock "cinder-quobyte-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[de56e0c1-7532-472d-9d8e-6d3a3c109aba]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:50 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f Jul 08 18:20:50 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:50 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:50 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:50 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b Jul 08 18:20:50 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:51 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.831s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:51 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Deleted volume successfully. Jul 08 18:20:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26575aed-6fb7-4372-81ba-b11e9a6482b2 tempest-AbsoluteLimitsTests-1451883685 None] Lock "cinder-dc73c3d8-bbf7-49c0-b605-171b8c9fd7b7-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:51 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" returned: 0 in 1.267s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:51 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 1G Jul 08 18:20:51 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:51 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" returned: 0 in 1.191s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:51 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b Jul 08 18:20:51 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:52 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" returned: 0 in 0.722s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Lock "cinder-quobyte-f659d96a-d2ce-4d3a-b8d0-1949a3612b7b" released by "delete_volume" :: held 2.014s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Created reservations ['e1f77fda-087d-4b16-af7d-b3ea1a26cc62'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:52 devstack cinder-volume[87309]: WARNING cinder.quota [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-445306673 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-445306673, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:20:52 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 1G" returned: 0 in 0.925s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Created reservations ['df4b5958-d76c-4339-859b-cd81523796fd', '51efce8d-fb66-4f0c-b38b-5665d5361158', '20a9d8d8-ede0-47b3-ae6a-dc1e92602c51', '6ece9fe9-8a0e-4cdf-9105-eb1e46210e87'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:20:52 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 Jul 08 18:20:52 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:52 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:20:52 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:53 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.862s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:53 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:20:53 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-37145643-0f1a-485e-8e69-a26d09bd3d4a tempest-GroupSnapshotsV319Test-1828771685 None] Delete group completed successfully. Jul 08 18:20:53 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85" returned: 0 in 1.132s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:53 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 is being set with open permissions: ugo+rw Jul 08 18:20:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:53 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 Jul 08 18:20:53 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:54 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85" returned: 0 in 0.722s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:54 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.info Jul 08 18:20:54 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:55 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.info" returned: 0 in 0.792s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:55 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.info is being set with open permissions: ugo+rw Jul 08 18:20:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:55 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.info Jul 08 18:20:55 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:56 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.info" returned: 0 in 0.758s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.780s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-715dcd31-a968-44de-87a9-cc30f1f44f6b tempest-VolumesSnapshotTestJSON-1638421444 None] Create snapshot completed successfully Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Flow 'volume_create_manager' (cd0cabde-8391-49df-bd69-2710fcbe265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0959b478-94a3-467e-b872-ff10104390ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0959b478-94a3-467e-b872-ff10104390ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-362138470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e6f6e5-ed8b-47ac-ac91-3f4c537cb244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbbe511fea34e918cb5775181016203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:56Z,use_quota=True,user_id='28d0751fdccf432bb072782ea2ee9779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a284d9-29e6-43dd-9a4f-285183ca4106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a284d9-29e6-43dd-9a4f-285183ca4106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4977baae-9158-409b-bdcc-68eadf729ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4977baae-9158-409b-bdcc-68eadf729ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e6f6e5-ed8b-47ac-ac91-3f4c537cb244', 'volume_name': 'volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de9c9b9-1865-4b69-8f75-c08507b81b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de9c9b9-1865-4b69-8f75-c08507b81b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c23586c-dd86-4fad-beae-9ab35a39b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Volume 66e6f6e5-ed8b-47ac-ac91-3f4c537cb244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244', 'volume_size': 1} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-362138470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e6f6e5-ed8b-47ac-ac91-3f4c537cb244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbbe511fea34e918cb5775181016203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:56Z,use_quota=True,user_id='28d0751fdccf432bb072782ea2ee9779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Creating volume 66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:56 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:56 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 1073741824 Jul 08 18:20:56 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Flow 'volume_create_manager' (0325a48c-cac9-46c2-9055-211f441b6505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fca7afe-c87e-4974-94ff-85230cbdf448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fca7afe-c87e-4974-94ff-85230cbdf448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1176180206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a3237a-9b57-472b-8e5f-25d40a9f2cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42019e9e9f64b84b8db3a5d8c341524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:57Z,use_quota=True,user_id='2b235bca648b4f2a9be8046859f16012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac75a790-393e-4f13-b606-bf7809fda605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac75a790-393e-4f13-b606-bf7809fda605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd170d2-66e2-41c6-ba5a-ee0fcdd246a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd170d2-66e2-41c6-ba5a-ee0fcdd246a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a3237a-9b57-472b-8e5f-25d40a9f2cdb', 'volume_name': 'volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd4433f-635c-4752-98dd-b5fbf8315b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd4433f-635c-4752-98dd-b5fbf8315b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a61f3e5-ad4f-430d-a24b-e3644bdadc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:56 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Volume 77a3237a-9b57-472b-8e5f-25d40a9f2cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb', 'volume_size': 1} Jul 08 18:20:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (7fae7879-67d5-4765-830e-c0834daa0de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc8567f-044c-43fc-b549-e5e7cd01a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc8567f-044c-43fc-b549-e5e7cd01a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-673011628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982c26f5-c608-4da0-9bad-bbc2e3b0d5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ca240eb3b4b4cab8cca5a1b6d8ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a6feae3-f3eb-482a-8e90-e52ef43e4d85,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:57Z,use_quota=True,user_id='a53b620187234b7b80acd3ace96e2ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f28a6e-cf39-4f23-848d-f899c5fea44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f28a6e-cf39-4f23-848d-f899c5fea44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927066c7-8133-4bd3-bb33-d3d56acd5497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927066c7-8133-4bd3-bb33-d3d56acd5497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '982c26f5-c608-4da0-9bad-bbc2e3b0d5f7', 'volume_name': 'volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7', 'volume_size': 1, 'snapshot_id': '1a6feae3-f3eb-482a-8e90-e52ef43e4d85'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9300e0ab-f1e2-4a29-961f-5d2cc7892dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9300e0ab-f1e2-4a29-961f-5d2cc7892dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b0caf6-d712-41fd-ac22-304d629df2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:57 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume 982c26f5-c608-4da0-9bad-bbc2e3b0d5f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7', 'volume_size': 1, 'snapshot_id': '1a6feae3-f3eb-482a-8e90-e52ef43e4d85'} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:57 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 1073741824" returned: 0 in 0.998s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:57 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 Jul 08 18:20:57 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:58 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244" returned: 0 in 0.667s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1176180206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a3237a-9b57-472b-8e5f-25d40a9f2cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42019e9e9f64b84b8db3a5d8c341524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:20:57Z,use_quota=True,user_id='2b235bca648b4f2a9be8046859f16012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Creating volume 77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:20:58 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c23586c-dd86-4fad-beae-9ab35a39b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a1b65a-8657-4536-a4d7-27c5637b033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:58 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb 1073741824 Jul 08 18:20:58 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:58 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Volume volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 (66e6f6e5-ed8b-47ac-ac91-3f4c537cb244): created successfully Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a1b65a-8657-4536-a4d7-27c5637b033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Flow 'volume_create_manager' (cd0cabde-8391-49df-bd69-2710fcbe265d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:20:58 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-089b4b5d-8ede-4b25-ba1d-9dfb96ed114a tempest-AttachVolumeNegativeTest-1469097328 None] Created volume successfully. Jul 08 18:20:58 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b46ffac9-bf2e-4236-86b6-7b2d075e32e3 tempest-GroupsTest-1062825123 None] Group tempest-Group1-1598704933: creating Jul 08 18:20:58 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b46ffac9-bf2e-4236-86b6-7b2d075e32e3 tempest-GroupsTest-1062825123 None] Group tempest-Group1-1598704933: created successfully Jul 08 18:20:58 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b46ffac9-bf2e-4236-86b6-7b2d075e32e3 tempest-GroupsTest-1062825123 None] Create group completed successfully. Jul 08 18:20:59 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb 1073741824" returned: 0 in 0.891s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:20:59 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb Jul 08 18:20:59 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:20:59 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" returned: 0 in 0.666s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.540s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-1a6feae3-f3eb-482a-8e90-e52ef43e4d85-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a61f3e5-ad4f-430d-a24b-e3644bdadc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7a2b53-6115-49d9-8f73-2e4563012a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-1a6feae3-f3eb-482a-8e90-e52ef43e4d85-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Creating volume 982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 from snapshot 1a6feae3-f3eb-482a-8e90-e52ef43e4d85 {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:20:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:00 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Volume volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb (77a3237a-9b57-472b-8e5f-25d40a9f2cdb): created successfully Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7a2b53-6115-49d9-8f73-2e4563012a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Flow 'volume_create_manager' (0325a48c-cac9-46c2-9055-211f441b6505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] snapshot: 1a6feae3-f3eb-482a-8e90-e52ef43e4d85, volume: 982c26f5-c608-4da0-9bad-bbc2e3b0d5f7, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:21:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ffd8dfff-9061-41e5-9247-633c77e446a7 tempest-GroupsTest-1062825123 None] Group tempest-Group2-1982145598: creating Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3500a574-a606-4a15-a844-1d3ecfca799c tempest-VolumesCloneTest-1496238650 None] Created volume successfully. Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0f09dd-a9ba-4b03-93b2-ab71176d3a29]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ffd8dfff-9061-41e5-9247-633c77e446a7 tempest-GroupsTest-1062825123 None] Group tempest-Group2-1982145598: created successfully Jul 08 18:21:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ffd8dfff-9061-41e5-9247-633c77e446a7 tempest-GroupsTest-1062825123 None] Create group completed successfully. Jul 08 18:21:00 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 Jul 08 18:21:00 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:00 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85" returned: 0 in 0.756s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03242be-d186-48d3-89f0-17c14c69f678]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:00 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f Jul 08 18:21:00 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:01 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" returned: 0 in 0.866s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:01 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 Jul 08 18:21:01 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Flow 'volume_create_manager' (5cb2a913-d29c-4e0a-9c21-2d63279ecaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b073e56a-4999-40e2-b6b3-aa57654a51e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b073e56a-4999-40e2-b6b3-aa57654a51e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-588895552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab40434-c8a9-4670-858e-89081562e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42019e9e9f64b84b8db3a5d8c341524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=77a3237a-9b57-472b-8e5f-25d40a9f2cdb,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:02Z,use_quota=True,user_id='2b235bca648b4f2a9be8046859f16012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e83117-cc52-405a-9480-6a3786433e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e83117-cc52-405a-9480-6a3786433e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3b1830-d30a-468b-b974-f635c458bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-6529ec81-bb05-47fc-92a3-1a693b874b95 req-51873b2b-8e04-43e9-b78a-412d8f067603 tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3b1830-d30a-468b-b974-f635c458bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8ab40434-c8a9-4670-858e-89081562e567', 'volume_name': 'volume-8ab40434-c8a9-4670-858e-89081562e567', 'volume_size': 2, 'source_volid': '77a3237a-9b57-472b-8e5f-25d40a9f2cdb', 'source_volstatus': 'available'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3949b7a2-0974-4757-a33e-dbd1caa4bcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3949b7a2-0974-4757-a33e-dbd1caa4bcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a76a13b-45a6-46ed-9d7a-f38a6fa420c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:02 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Volume 8ab40434-c8a9-4670-858e-89081562e567: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8ab40434-c8a9-4670-858e-89081562e567', 'volume_size': 2, 'source_volid': '77a3237a-9b57-472b-8e5f-25d40a9f2cdb', 'source_volstatus': 'available'} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Flow 'volume_create_manager' (c9e786a7-e79e-49dd-b4cf-ddfa8504e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf826085-90e6-48f4-947d-b0a0e22e0bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf826085-90e6-48f4-947d-b0a0e22e0bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1052360634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f554d60e-2b90-44da-87d2-841db213a791,host='devstack@QuobyteHD#QuobyteHD',id=3a1adde2-680b-4f38-841a-a55770840df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf73db6071e5432ca43db97f455dadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:02Z,use_quota=True,user_id='32cb85d876724d21a6ef4a25dd23a94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1294cf21-aed9-4dc8-8590-9ee15325c719),volume_type_id=1294cf21-aed9-4dc8-8590-9ee15325c719)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c09fe6c-ac88-412f-9e61-de0b817ba761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c09fe6c-ac88-412f-9e61-de0b817ba761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8485195b-2db5-460b-9545-203da5ac63ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8485195b-2db5-460b-9545-203da5ac63ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a1adde2-680b-4f38-841a-a55770840df9', 'volume_name': 'volume-3a1adde2-680b-4f38-841a-a55770840df9', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d60bd5-5d8f-4878-a052-335905cf768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d60bd5-5d8f-4878-a052-335905cf768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b169334-b4a4-46d3-89d0-8ef61cab1194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:02 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Volume 3a1adde2-680b-4f38-841a-a55770840df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a1adde2-680b-4f38-841a-a55770840df9', 'volume_size': 1} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:02 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:02 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:03 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.941s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:21:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:21:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:21:06 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" returned: 0 in 5.052s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:06 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b1b89-8e41-4b24-8cac-0341530f2d09]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:06 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f Jul 08 18:21:06 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:07 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" returned: 0 in 0.928s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:07 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:21:07 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Converted 1024.00 MB image at 202.51 MB/s Jul 08 18:21:07 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 is being set with open permissions: ugo+rw Jul 08 18:21:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:07 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 Jul 08 18:21:07 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:08 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" returned: 0 in 0.619s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" released by "_copy_volume_from_snapshot" :: held 8.328s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-1a6feae3-f3eb-482a-8e90-e52ef43e4d85-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" released by "_create_volume_from_snapshot" :: held 8.397s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.440s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-6529ec81-bb05-47fc-92a3-1a693b874b95 req-51873b2b-8e04-43e9-b78a-412d8f067603 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.353s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8161b94c-6d19-4695-8d1c-63dabe0dcead]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-6529ec81-bb05-47fc-92a3-1a693b874b95 req-51873b2b-8e04-43e9-b78a-412d8f067603 tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b0caf6-d712-41fd-ac22-304d629df2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7', 'volume_size': 1, 'snapshot_id': '1a6feae3-f3eb-482a-8e90-e52ef43e4d85'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e442bd5-eeb3-41a4-8310-9d4ee491ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:08 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Volume volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 (982c26f5-c608-4da0-9bad-bbc2e3b0d5f7): created successfully Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e442bd5-eeb3-41a4-8310-9d4ee491ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Flow 'volume_create_manager' (7fae7879-67d5-4765-830e-c0834daa0de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:08 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-fa2d7db5-ba7c-4f6a-8f71-fb81fd8621b9 tempest-VolumesSnapshotTestJSON-1638421444 None] Created volume successfully. Jul 08 18:21:08 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 Jul 08 18:21:08 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a617a2-5906-4462-b7a6-28c66e7cd3d4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:08 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 Jul 08 18:21:08 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:09 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-6529ec81-bb05-47fc-92a3-1a693b874b95 req-51873b2b-8e04-43e9-b78a-412d8f067603 tempest-AttachVolumeNegativeTest-1469097328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244" returned: 0 in 0.798s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-6529ec81-bb05-47fc-92a3-1a693b874b95 req-51873b2b-8e04-43e9-b78a-412d8f067603 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.120s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:09 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Cloning volume 77a3237a-9b57-472b-8e5f-25d40a9f2cdb to volume 8ab40434-c8a9-4670-858e-89081562e567 Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Creating offline snapshot 381d22ef-1948-4651-9e87-8159268a1188 of volume 77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-6529ec81-bb05-47fc-92a3-1a693b874b95 req-51873b2b-8e04-43e9-b78a-412d8f067603 tempest-AttachVolumeNegativeTest-1469097328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8a718e1-ed0c-49d4-822b-a4a07d48fee5', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a41b2e4-1065-4362-8ca1-c476050aa0e1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-6529ec81-bb05-47fc-92a3-1a693b874b95 req-51873b2b-8e04-43e9-b78a-412d8f067603 tempest-AttachVolumeNegativeTest-1469097328 None] attachment_update completed successfully. Jul 08 18:21:09 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb Jul 08 18:21:09 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:09 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" returned: 0 in 0.797s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:09 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7 Jul 08 18:21:09 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:10 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" returned: 0 in 0.801s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:10 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 1G Jul 08 18:21:10 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:10 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" returned: 0 in 0.700s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7" released by "delete_volume" :: held 1.536s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Created reservations ['d82707ef-5674-48a3-8422-7ee003347d9b', 'b0131bb4-1a3a-4aa2-8595-84991da3495d', 'a768df5b-913b-4ce8-b55e-9822a385d981', 'd2f0dadb-c331-49a5-b841-383519532bec'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:10 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:10 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-1a6feae3-f3eb-482a-8e90-e52ef43e4d85-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:10 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 1G" returned: 0 in 0.901s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-1a6feae3-f3eb-482a-8e90-e52ef43e4d85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:11 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 Jul 08 18:21:11 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-1a6feae3-f3eb-482a-8e90-e52ef43e4d85" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-1a6feae3-f3eb-482a-8e90-e52ef43e4d85" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Deleting offline snapshot 1a6feae3-f3eb-482a-8e90-e52ef43e4d85 of volume c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] snapshot_file for this snap is: volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d581a40e-3067-4f2f-962e-9b5b35c643ae]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:11 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.723s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Deleted volume successfully. Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=123,cinder:SELECT=105,cinder:INSERT=29,cinder:DELETE=13 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:21:11 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 Jul 08 18:21:11 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3372728d-b1bf-4617-89c5-dc07715be5c0 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-982c26f5-c608-4da0-9bad-bbc2e3b0d5f7-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:11 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188" returned: 0 in 0.719s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:11 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 is being set with open permissions: ugo+rw Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:11 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 Jul 08 18:21:11 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:11 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85" returned: 0 in 0.788s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ea69ea-8d41-4479-8159-85dfb011b7ef]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:12 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f Jul 08 18:21:12 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:12 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188" returned: 0 in 0.664s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:12 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=113,cinder:INSERT=28,cinder:UPDATE=126,cinder:DELETE=7 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:21:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:12 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.info Jul 08 18:21:12 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:12 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" returned: 0 in 0.772s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:12 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 Jul 08 18:21:12 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:13 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.info" returned: 0 in 0.668s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:13 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.info is being set with open permissions: ugo+rw Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:13 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.info Jul 08 18:21:13 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:13 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85" returned: 0 in 0.765s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:13 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85 Jul 08 18:21:13 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:13 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.info" returned: 0 in 0.692s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "cinder-quobyte-8ab40434-c8a9-4670-858e-89081562e567" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-quobyte-8ab40434-c8a9-4670-858e-89081562e567" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] snapshot: 381d22ef-1948-4651-9e87-8159268a1188, volume: 8ab40434-c8a9-4670-858e-89081562e567, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec6e746-6ac6-497e-8f76-093b8e3745ec]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:14 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 Jul 08 18:21:14 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:14 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f.1a6feae3-f3eb-482a-8e90-e52ef43e4d85" returned: 0 in 0.654s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-1a6feae3-f3eb-482a-8e90-e52ef43e4d85" released by "_delete_snapshot" :: held 3.111s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" released by "delete_snapshot" :: held 3.137s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Created reservations ['bb511b9c-0e84-4aba-aaf3-9b6d362970d4', '4d8421cb-8d65-4b85-9f02-753957179d1f', 'c608a38a-7a54-4e24-be5a-fec3f420f0dd', 'dec33a41-ef7a-47aa-93d0-6ddaec6192cd'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Delete snapshot completed successfully. Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7934b64e-e85f-45ce-a858-fc924797abf6 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-1a6feae3-f3eb-482a-8e90-e52ef43e4d85-delete_snapshot" released by "delete_snapshot" :: held 3.311s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:14 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188" returned: 0 in 0.874s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[541fe8b8-3194-4d08-bddb-2f39d766aadb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:14 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb Jul 08 18:21:14 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" acquired by "delete_volume" :: waited 0.043s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da07224-2a7c-4a67-a8ba-065fbda9505f]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:15 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" returned: 0 in 0.884s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:15 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 Jul 08 18:21:15 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:15 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f Jul 08 18:21:15 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-f7e17e44-340d-4f74-9abf-ec689a39a069 req-d09d42b3-3a53-42b2-9d4b-a375aa99a8df tempest-AttachVolumeNegativeTest-1469097328 None] Terminate volume connection completed successfully. Jul 08 18:21:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-f7e17e44-340d-4f74-9abf-ec689a39a069 req-d09d42b3-3a53-42b2-9d4b-a375aa99a8df tempest-AttachVolumeNegativeTest-1469097328 None] Deleting attachment e8a718e1-ed0c-49d4-822b-a4a07d48fee5. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:21:16 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" returned: 0 in 0.795s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:16 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f Jul 08 18:21:16 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:17 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" returned: 0 in 1.324s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f" released by "delete_volume" :: held 2.243s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:17 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Created reservations ['ddef35a4-c1a2-4512-ae3f-dcab07173af6', 'c83f4f59-2e1d-4a25-9152-f5f790754a75', '5122b61f-4803-4a96-b959-63fe02d98364', 'f6f6066c-e8e5-4e90-b69e-84268b1ddaa8'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:18 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:18 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-15e970c1-1e8d-40ac-a8f0-ffe3079001a4-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-15e970c1-1e8d-40ac-a8f0-ffe3079001a4-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "cinder-quobyte-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" acquired by "delete_volume" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[069eee7b-5238-40c2-9e56-c7a01a0c076e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:19 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.764s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:19 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Deleted volume successfully. Jul 08 18:21:19 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 Jul 08 18:21:19 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-83e7ae48-2e82-4110-9225-989ec7adb4e9 tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-c6c808c2-6301-4d01-9fd5-ee94c4b64c0f-delete_volume" released by "delete_volume" :: held 4.516s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:21 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" returned: 0 in 1.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:21 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4 Jul 08 18:21:21 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:21 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567" returned: 0 in 5.800s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:21 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f11d5-e7f6-440d-9b67-a2972d63920c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:21 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb Jul 08 18:21:21 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:22 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" returned: 0 in 0.789s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-quobyte-15e970c1-1e8d-40ac-a8f0-ffe3079001a4" released by "delete_volume" :: held 2.623s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Created reservations ['b5de5947-97ee-4235-ad9e-26d24a23af59', '56c0e051-a9f3-4492-8d80-ed7f20bd0778', '0fdfe3c7-d0d4-43c9-8729-a4a607296230', 'f15a056e-7f9b-4a7a-8c23-0f86335cc846'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:22 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:22 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:22 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" returned: 0 in 1.098s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:21:22 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Converted 1024.00 MB image at 176.50 MB/s Jul 08 18:21:22 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 is being set with open permissions: ugo+rw Jul 08 18:21:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:22 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 Jul 08 18:21:22 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:23 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.820s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Deleted volume successfully. Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7f628a79-5c2d-4dd5-95ac-6c418c232b5c tempest-VolumesSnapshotTestJSON-1638421444 None] Lock "cinder-15e970c1-1e8d-40ac-a8f0-ffe3079001a4-delete_volume" released by "delete_volume" :: held 3.754s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:23 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567" returned: 0 in 0.795s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-quobyte-8ab40434-c8a9-4670-858e-89081562e567" released by "_copy_volume_from_snapshot" :: held 9.540s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "cinder-quobyte-381d22ef-1948-4651-9e87-8159268a1188" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-quobyte-381d22ef-1948-4651-9e87-8159268a1188" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Deleting offline snapshot 381d22ef-1948-4651-9e87-8159268a1188 of volume 77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] snapshot_file for this snap is: volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6242dd-8a2d-4bbb-a260-fab0774647fe]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:23 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 Jul 08 18:21:23 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:24 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188" returned: 0 in 0.857s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:21:24 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9446c460-88c7-485f-8bd6-da76d3189e87]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:24 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb Jul 08 18:21:24 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:25 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" returned: 0 in 0.851s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:25 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 Jul 08 18:21:25 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:26 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188" returned: 0 in 0.842s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:26 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188 Jul 08 18:21:26 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:26 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb.381d22ef-1948-4651-9e87-8159268a1188" returned: 0 in 0.727s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-quobyte-381d22ef-1948-4651-9e87-8159268a1188" released by "_delete_snapshot" :: held 3.390s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.597s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.671s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f554d60e-2b90-44da-87d2-841db213a791,created_at=2026-07-08T16:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1052360634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f554d60e-2b90-44da-87d2-841db213a791,host='devstack@QuobyteHD#QuobyteHD',id=3a1adde2-680b-4f38-841a-a55770840df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf73db6071e5432ca43db97f455dadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:02Z,use_quota=True,user_id='32cb85d876724d21a6ef4a25dd23a94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1294cf21-aed9-4dc8-8590-9ee15325c719),volume_type_id=1294cf21-aed9-4dc8-8590-9ee15325c719)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Creating volume 3a1adde2-680b-4f38-841a-a55770840df9 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:21:26 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:26 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 1073741824 Jul 08 18:21:26 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a76a13b-45a6-46ed-9d7a-f38a6fa420c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab40434-c8a9-4670-858e-89081562e567', 'volume_size': 2, 'source_volid': '77a3237a-9b57-472b-8e5f-25d40a9f2cdb', 'source_volstatus': 'available'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56f1fcd-a2cf-484e-b814-c5c95d431234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:26 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Volume volume-8ab40434-c8a9-4670-858e-89081562e567 (8ab40434-c8a9-4670-858e-89081562e567): created successfully Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56f1fcd-a2cf-484e-b814-c5c95d431234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Flow 'volume_create_manager' (5cb2a913-d29c-4e0a-9c21-2d63279ecaff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:26 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-de0ffc2b-78de-4592-99bb-89a7f8023240 tempest-VolumesCloneTest-1496238650 None] Created volume successfully. Jul 08 18:21:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "cinder-8ab40434-c8a9-4670-858e-89081562e567-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-8ab40434-c8a9-4670-858e-89081562e567-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "cinder-quobyte-8ab40434-c8a9-4670-858e-89081562e567" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-quobyte-8ab40434-c8a9-4670-858e-89081562e567" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f90f319-107a-4793-8fa0-a30a91551ca8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:27 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 Jul 08 18:21:27 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:27 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 1073741824" returned: 0 in 1.083s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:27 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 Jul 08 18:21:28 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:28 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567" returned: 0 in 0.995s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:28 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567 Jul 08 18:21:28 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:28 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9" returned: 0 in 0.770s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "cinder-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b169334-b4a4-46d3-89d0-8ef61cab1194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a1adde2-680b-4f38-841a-a55770840df9', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976e5610-97d5-4220-9898-cd327eb03c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:28 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Volume volume-3a1adde2-680b-4f38-841a-a55770840df9 (3a1adde2-680b-4f38-841a-a55770840df9): created successfully Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976e5610-97d5-4220-9898-cd327eb03c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Flow 'volume_create_manager' (c9e786a7-e79e-49dd-b4cf-ddfa8504e493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6f3f4fc3-089b-475d-b740-646d9172598e tempest-GroupsTest-1062825123 None] Created volume successfully. Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "cinder-quobyte-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-quobyte-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[122bd581-60ca-4c01-b22a-34023221ff93]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:29 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 Jul 08 18:21:29 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:29 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ab40434-c8a9-4670-858e-89081562e567" returned: 0 in 0.770s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-quobyte-8ab40434-c8a9-4670-858e-89081562e567" released by "delete_volume" :: held 1.826s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Created reservations ['0c707ca0-13cc-4909-bcdf-8a77b9c767bf', '6b1d9172-483c-43d7-8b07-4ed6f978b11b', '5ce0daa0-eb8f-4675-a0a0-7ac3e7537b16', '02e688d8-efc5-4cbb-8319-f6c617a00fa2'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:21:29 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:29 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Flow 'volume_create_manager' (8d3255b0-8d8e-4380-a632-bc9390efe39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151fb5fa-b245-4eb2-ad3f-1caa5847f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151fb5fa-b245-4eb2-ad3f-1caa5847f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-980035902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2875bd34-7427-4005-b92c-7349ad39358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea30f3051f14918b723235f63bf4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:29Z,use_quota=True,user_id='65bc2a0bf98e4da19ad362fbe4abe583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107896ef-283d-4e76-a076-0348bb42b246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107896ef-283d-4e76-a076-0348bb42b246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fde819c-620c-43d5-b424-8bf6982775fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fde819c-620c-43d5-b424-8bf6982775fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2875bd34-7427-4005-b92c-7349ad39358e', 'volume_name': 'volume-2875bd34-7427-4005-b92c-7349ad39358e', 'volume_size': 2}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5e4a63-a999-4f12-9a6f-62643da43464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5e4a63-a999-4f12-9a6f-62643da43464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d7f018-6267-42d7-963c-0a317c658b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:29 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Volume 2875bd34-7427-4005-b92c-7349ad39358e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2875bd34-7427-4005-b92c-7349ad39358e', 'volume_size': 2} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-980035902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2875bd34-7427-4005-b92c-7349ad39358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea30f3051f14918b723235f63bf4231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:29Z,use_quota=True,user_id='65bc2a0bf98e4da19ad362fbe4abe583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Creating volume 2875bd34-7427-4005-b92c-7349ad39358e {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:21:29 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e 2147483648 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:29 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e 2147483648 Jul 08 18:21:29 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:29 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244" returned: 0 in 0.955s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "cinder-77a3237a-9b57-472b-8e5f-25d40a9f2cdb-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:29 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244 Jul 08 18:21:29 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-77a3237a-9b57-472b-8e5f-25d40a9f2cdb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "cinder-quobyte-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-quobyte-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e3fd6b-9405-4eff-b9fc-640858fd5a43]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:30 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb Jul 08 18:21:30 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:30 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.941s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:30 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Deleted volume successfully. Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Acquiring lock "cinder-quobyte-3a1adde2-680b-4f38-841a-a55770840df9" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-eb838e90-28b3-4550-be06-f386b5131e87 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-8ab40434-c8a9-4670-858e-89081562e567-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Lock "cinder-quobyte-3a1adde2-680b-4f38-841a-a55770840df9" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88d9193-cd0f-45e1-96c0-b02a41dec79a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:30 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 Jul 08 18:21:30 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:30 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e 2147483648" returned: 0 in 1.220s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:30 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e Jul 08 18:21:30 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:30 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244" returned: 0 in 1.016s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-quobyte-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244" released by "delete_volume" :: held 2.020s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:30 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Created reservations ['50274387-0bbb-4d37-84ba-e62114a350ee', '762c2f53-7997-4a61-80e2-02f8f8f95b26', '85c0d9fa-9ddd-4ea1-8bd7-7f2d1a79dac3', '77cd53c3-a30a-486a-bd6e-8cd5246046d3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:31 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:31 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:31 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" returned: 0 in 1.062s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:31 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb Jul 08 18:21:31 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "cinder-843b1f95-4983-41b7-b098-4b5082cc1b5b-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-843b1f95-4983-41b7-b098-4b5082cc1b5b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "cinder-quobyte-843b1f95-4983-41b7-b098-4b5082cc1b5b" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-quobyte-843b1f95-4983-41b7-b098-4b5082cc1b5b" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b8559-c906-49ae-b5b9-40464ade8c16]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:31 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9" returned: 0 in 1.003s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:31 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9 Jul 08 18:21:31 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:31 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b Jul 08 18:21:31 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:31 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e" returned: 0 in 1.010s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d7f018-6267-42d7-963c-0a317c658b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2875bd34-7427-4005-b92c-7349ad39358e', 'volume_size': 2}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d50862d-f3cb-41e5-a795-d929db96e78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:31 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Volume volume-2875bd34-7427-4005-b92c-7349ad39358e (2875bd34-7427-4005-b92c-7349ad39358e): created successfully Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d50862d-f3cb-41e5-a795-d929db96e78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Flow 'volume_create_manager' (8d3255b0-8d8e-4380-a632-bc9390efe39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:32 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ceaec18c-adf2-43b6-b8a1-a1f879a0cd06 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Created volume successfully. Jul 08 18:21:32 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" returned: 0 in 0.900s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-quobyte-77a3237a-9b57-472b-8e5f-25d40a9f2cdb" released by "delete_volume" :: held 2.072s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:32 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.023s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:32 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Deleted volume successfully. Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Created reservations ['22f3cbee-1c14-4d3e-ba2b-e063b3317521', '0b0fbad4-04d9-467c-91e0-5f51bb59b164', '1ba2b3e2-0a22-4cdf-a90d-721a2cb80eaa', '82c6d17a-282d-41b9-856e-c7ceedc35ba3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-51bec9ea-b1f7-4146-bbd1-1f4a538b3e1e tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-66e6f6e5-ed8b-47ac-ac91-3f4c537cb244-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:32 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:32 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:32 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a1adde2-680b-4f38-841a-a55770840df9" returned: 0 in 0.927s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Lock "cinder-quobyte-3a1adde2-680b-4f38-841a-a55770840df9" released by "delete_volume" :: held 1.988s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Created reservations ['f79ef06a-edea-4cd8-95e1-20723939eb19'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:32 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b" returned: 0 in 1.148s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:32 devstack cinder-volume[87309]: WARNING cinder.quota [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1022423527 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1022423527, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:21:32 devstack cinder-volume[87309]: WARNING cinder.quota [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1022423527 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1022423527, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Created reservations ['e8d8aefa-8f05-47f4-9865-edb235f6b81d', '5516a92c-b6dc-40dd-bdce-b903bba47ad9', 'f469c148-1ed7-4fbc-8023-0e3218900bd0', '6979a232-638c-418f-8f7a-526f5dd2ca4f'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:32 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b Jul 08 18:21:32 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:33 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:33 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Creating offline snapshot dbc2f782-b202-4d43-95d0-e90a65c58594 of volume 2875bd34-7427-4005-b92c-7349ad39358e {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[554b4493-523f-4a19-812b-9e138b317f2a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:33 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.903s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:33 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Deleted volume successfully. Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46851217-51e7-45d1-a1c4-6941f4983e33 tempest-VolumesCloneTest-1496238650 None] Lock "cinder-77a3237a-9b57-472b-8e5f-25d40a9f2cdb-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:33 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e Jul 08 18:21:33 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Created reservations ['cb4a761f-9d79-477f-b5b4-1184c27bfded'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:33 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:33 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:33 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-843b1f95-4983-41b7-b098-4b5082cc1b5b" returned: 0 in 1.066s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-quobyte-843b1f95-4983-41b7-b098-4b5082cc1b5b" released by "delete_volume" :: held 2.292s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Created reservations ['2cc15f4f-e5d7-4cb0-b56e-471aca54e5a0', '07f5d5eb-1070-430f-9f5b-d04560209f9a', '22c9db3a-27ad-4df0-b3f3-b7e72f6bdddd', '2a1f619a-da8f-4154-87a9-f60da18d2a00'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:33 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.065s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:34 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1acce899-9c47-4690-a333-5fc6c1deb34f tempest-GroupsTest-1062825123 None] Delete group completed successfully. Jul 08 18:21:34 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:34 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:34 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e" returned: 0 in 1.100s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 2G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:34 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 2G Jul 08 18:21:34 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:34 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.969s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:34 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:34 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ca15b775-64d4-4fd1-bb6a-224655038ecc tempest-GroupsTest-1062825123 None] Delete group completed successfully. Jul 08 18:21:35 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.019s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Deleted volume successfully. Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2e5051b-b75d-4d7a-85db-486dec63e19b tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-843b1f95-4983-41b7-b098-4b5082cc1b5b-delete_volume" released by "delete_volume" :: held 3.686s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "cinder-0a82be5c-9862-4260-aa04-70e8c6fb922c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dc078820-14f0-4fe1-a28c-23138df1ccf6 tempest-GroupsTest-1062825123 None] Group tempest-GroupsTest-Group-421569805: creating Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-0a82be5c-9862-4260-aa04-70e8c6fb922c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dc078820-14f0-4fe1-a28c-23138df1ccf6 tempest-GroupsTest-1062825123 None] Group tempest-GroupsTest-Group-421569805: created successfully Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "cinder-quobyte-0a82be5c-9862-4260-aa04-70e8c6fb922c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dc078820-14f0-4fe1-a28c-23138df1ccf6 tempest-GroupsTest-1062825123 None] Create group completed successfully. Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-quobyte-0a82be5c-9862-4260-aa04-70e8c6fb922c" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a12443a-e7e2-447e-8e31-f979f5c1e594]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:35 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c Jul 08 18:21:35 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:35 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 2G" returned: 0 in 1.218s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2875bd34-7427-4005-b92c-7349ad39358e -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:35 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2875bd34-7427-4005-b92c-7349ad39358e -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 Jul 08 18:21:35 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:36 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c" returned: 0 in 0.848s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:36 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c Jul 08 18:21:36 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:36 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2875bd34-7427-4005-b92c-7349ad39358e -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594" returned: 0 in 0.765s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:36 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 is being set with open permissions: ugo+rw Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:36 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 Jul 08 18:21:36 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Flow 'volume_create_manager' (49c75f48-83eb-4450-8e96-7bb7398c3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31a0b2f-effc-41a5-871f-e2be01400966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31a0b2f-effc-41a5-871f-e2be01400966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2100919446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857a2cfb-e25f-4037-8892-d363eed94256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02929452dcfe4ec8a26b34900688e0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:37Z,use_quota=True,user_id='49e847fff34144a68fe750b3c1fed000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8657a3d2-a9bf-4d67-9432-a4dd96732efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8657a3d2-a9bf-4d67-9432-a4dd96732efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07ab1fc-5efc-483a-89e1-7fff2fcf5c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07ab1fc-5efc-483a-89e1-7fff2fcf5c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857a2cfb-e25f-4037-8892-d363eed94256', 'volume_name': 'volume-857a2cfb-e25f-4037-8892-d363eed94256', 'volume_size': 2}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9138c3f-6380-4f71-ad45-98feb9e779ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9138c3f-6380-4f71-ad45-98feb9e779ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45c1af5-4807-427f-8970-95dcb31b5545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:37 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Volume 857a2cfb-e25f-4037-8892-d363eed94256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857a2cfb-e25f-4037-8892-d363eed94256', 'volume_size': 2} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Flow 'volume_create_manager' (c0bef8a8-7117-41cc-be0d-0f03213b438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fadcf94-fb17-4182-adb1-cb84691d10a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fadcf94-fb17-4182-adb1-cb84691d10a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890364986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2353bd4e-cbab-4846-954a-acb4767788ac,host='devstack@QuobyteHD#QuobyteHD',id=95f909c4-904f-49c1-babb-ff1ac3f58c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf73db6071e5432ca43db97f455dadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:37Z,use_quota=True,user_id='32cb85d876724d21a6ef4a25dd23a94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(855f68d4-6e7d-4dec-a6e1-27229e8519db),volume_type_id=855f68d4-6e7d-4dec-a6e1-27229e8519db)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6eaa339-6b58-4b17-9e2d-d7691f14d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6eaa339-6b58-4b17-9e2d-d7691f14d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f1cd28-deeb-4e03-8db1-e2af965e77de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f1cd28-deeb-4e03-8db1-e2af965e77de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f909c4-904f-49c1-babb-ff1ac3f58c82', 'volume_name': 'volume-95f909c4-904f-49c1-babb-ff1ac3f58c82', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da34f9a1-2c40-4a5f-acf0-771d8816cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:37 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da34f9a1-2c40-4a5f-acf0-771d8816cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:37 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260ef407-2f8b-4fd1-a813-6160e58bfe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:37 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Volume 95f909c4-904f-49c1-babb-ff1ac3f58c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f909c4-904f-49c1-babb-ff1ac3f58c82', 'volume_size': 1} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0a82be5c-9862-4260-aa04-70e8c6fb922c" returned: 0 in 0.994s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594" returned: 0 in 0.931s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-quobyte-0a82be5c-9862-4260-aa04-70e8c6fb922c" released by "delete_volume" :: held 1.899s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:37 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.info Jul 08 18:21:37 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Created reservations ['490649ca-56ee-45c2-933a-2fc1e101eafe', '4a9585c8-3cc2-4122-9351-409f90cab92b', '50ae01bb-c510-459c-9c66-f315bbe6ddbe', '10fb6078-33ee-4439-9df5-9c381e3aea02'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:37 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:37 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:37 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.info" returned: 0 in 0.680s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:37 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.info is being set with open permissions: ugo+rw Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:37 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.info Jul 08 18:21:37 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:37 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.666s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Deleted volume successfully. Jul 08 18:21:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-14388ccc-f83f-4b2f-b8e1-a207d6c4b099 tempest-AttachVolumeNegativeTest-1469097328 None] Lock "cinder-0a82be5c-9862-4260-aa04-70e8c6fb922c-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:38 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.info" returned: 0 in 0.643s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.487s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2100919446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857a2cfb-e25f-4037-8892-d363eed94256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02929452dcfe4ec8a26b34900688e0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:37Z,use_quota=True,user_id='49e847fff34144a68fe750b3c1fed000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Creating volume 857a2cfb-e25f-4037-8892-d363eed94256 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:21:38 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:21:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 2147483648 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:38 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 2147483648 Jul 08 18:21:38 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-99bc3efb-9e1c-4cf6-8fc3-68d340b0cd1f tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Create snapshot completed successfully Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "cinder-dbc2f782-b202-4d43-95d0-e90a65c58594-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-dbc2f782-b202-4d43-95d0-e90a65c58594-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "cinder-quobyte-2875bd34-7427-4005-b92c-7349ad39358e" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-quobyte-2875bd34-7427-4005-b92c-7349ad39358e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "cinder-quobyte-dbc2f782-b202-4d43-95d0-e90a65c58594" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-quobyte-dbc2f782-b202-4d43-95d0-e90a65c58594" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Deleting offline snapshot dbc2f782-b202-4d43-95d0-e90a65c58594 of volume 2875bd34-7427-4005-b92c-7349ad39358e {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] snapshot_file for this snap is: volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0e8611-cd69-41b2-bdc5-f2fb7024d98a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:39 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:39 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 Jul 08 18:21:39 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 2147483648" returned: 0 in 1.115s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:39 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 Jul 08 18:21:39 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:40 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594" returned: 0 in 0.843s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2875bd34-7427-4005-b92c-7349ad39358e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:21:40 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256" returned: 0 in 0.678s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.266s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2353bd4e-cbab-4846-954a-acb4767788ac,created_at=2026-07-08T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890364986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2353bd4e-cbab-4846-954a-acb4767788ac,host='devstack@QuobyteHD#QuobyteHD',id=95f909c4-904f-49c1-babb-ff1ac3f58c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf73db6071e5432ca43db97f455dadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:37Z,use_quota=True,user_id='32cb85d876724d21a6ef4a25dd23a94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(855f68d4-6e7d-4dec-a6e1-27229e8519db),volume_type_id=855f68d4-6e7d-4dec-a6e1-27229e8519db)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Creating volume 95f909c4-904f-49c1-babb-ff1ac3f58c82 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:21:40 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a32ba5-ab1c-4770-9df0-181f0d8a174d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:40 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 1073741824 Jul 08 18:21:40 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45c1af5-4807-427f-8970-95dcb31b5545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857a2cfb-e25f-4037-8892-d363eed94256', 'volume_size': 2}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a7d80c-66f9-45f5-8471-c8572c0917df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:40 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Volume volume-857a2cfb-e25f-4037-8892-d363eed94256 (857a2cfb-e25f-4037-8892-d363eed94256): created successfully Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a7d80c-66f9-45f5-8471-c8572c0917df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Flow 'volume_create_manager' (49c75f48-83eb-4450-8e96-7bb7398c3b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0c8bdcac-7fe4-4a34-bfcc-33eadb7104db tempest-VolumesCloneNegativeTest-1635189363 None] Created volume successfully. Jul 08 18:21:40 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e Jul 08 18:21:40 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Acquiring lock "cinder-857a2cfb-e25f-4037-8892-d363eed94256-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Lock "cinder-857a2cfb-e25f-4037-8892-d363eed94256-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Acquiring lock "cinder-quobyte-857a2cfb-e25f-4037-8892-d363eed94256" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Lock "cinder-quobyte-857a2cfb-e25f-4037-8892-d363eed94256" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6b9bc-45ea-467f-85fe-205229e67d51]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:41 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 Jul 08 18:21:41 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:41 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e" returned: 0 in 0.996s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:41 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 Jul 08 18:21:41 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:41 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 1073741824" returned: 0 in 1.277s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:41 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 Jul 08 18:21:41 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:42 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594" returned: 0 in 0.863s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:42 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594 Jul 08 18:21:42 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:42 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256" returned: 0 in 1.102s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:42 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256 Jul 08 18:21:42 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:42 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82" returned: 0 in 0.781s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260ef407-2f8b-4fd1-a813-6160e58bfe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f909c4-904f-49c1-babb-ff1ac3f58c82', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf3d967-a880-470e-bb36-9e59863bc2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:42 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Volume volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 (95f909c4-904f-49c1-babb-ff1ac3f58c82): created successfully Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf3d967-a880-470e-bb36-9e59863bc2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Flow 'volume_create_manager' (c0bef8a8-7117-41cc-be0d-0f03213b438f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-52940afa-3919-47ca-be49-a5336476855c tempest-GroupsTest-1062825123 None] Created volume successfully. Jul 08 18:21:43 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857a2cfb-e25f-4037-8892-d363eed94256" returned: 0 in 0.732s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Lock "cinder-quobyte-857a2cfb-e25f-4037-8892-d363eed94256" released by "delete_volume" :: held 1.921s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:43 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e.dbc2f782-b202-4d43-95d0-e90a65c58594" returned: 0 in 0.830s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Created reservations ['2c332717-c155-4c7e-a490-ecdb5db3421c', '15c882bd-b476-4e5c-b0bb-3c0172f98869', '19384a38-15f9-4b75-a8a9-1f81b86a3192', '05113c53-df86-4b3f-845f-3eca8dd59b3a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-quobyte-dbc2f782-b202-4d43-95d0-e90a65c58594" released by "_delete_snapshot" :: held 3.714s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-quobyte-2875bd34-7427-4005-b92c-7349ad39358e" released by "delete_snapshot" :: held 3.749s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:43 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:43 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Created reservations ['37fca663-d6de-471c-812d-7d28d88bae5c', '3cb0f70f-bf6f-4cb8-9527-42c56b3e1332', '319c9bab-8b22-4dd8-9bcd-49bcdcc07533', 'c6d2c7d6-015d-4f2d-b73f-8b174a706e86'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Delete snapshot completed successfully. Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7e842adc-ab86-4d6b-9309-a32d0bcbcb23 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-dbc2f782-b202-4d43-95d0-e90a65c58594-delete_snapshot" released by "delete_snapshot" :: held 4.108s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Flow 'volume_create_manager' (72dcbed2-b1b0-4a5a-817d-ea17c776bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfc3d38-7aa2-4269-8b7d-74ddbfcc82f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfc3d38-7aa2-4269-8b7d-74ddbfcc82f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325422302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2353bd4e-cbab-4846-954a-acb4767788ac,host='devstack@QuobyteHD#QuobyteHD',id=44dd03c8-a58f-45d7-8d7d-4883ae9a8d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf73db6071e5432ca43db97f455dadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:44Z,use_quota=True,user_id='32cb85d876724d21a6ef4a25dd23a94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(855f68d4-6e7d-4dec-a6e1-27229e8519db),volume_type_id=855f68d4-6e7d-4dec-a6e1-27229e8519db)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbc130a-c199-4c49-80e4-9dd00deb7601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbc130a-c199-4c49-80e4-9dd00deb7601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa8fe9a-3f68-4c73-89e3-de002c212854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa8fe9a-3f68-4c73-89e3-de002c212854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44dd03c8-a58f-45d7-8d7d-4883ae9a8d26', 'volume_name': 'volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919a4215-17d9-4b2c-a0ef-fff847b3ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919a4215-17d9-4b2c-a0ef-fff847b3ef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9bbbc8-60d6-47a0-853e-e30b6e9abc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:43 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Volume 44dd03c8-a58f-45d7-8d7d-4883ae9a8d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26', 'volume_size': 1} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2353bd4e-cbab-4846-954a-acb4767788ac,created_at=2026-07-08T16:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-325422302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2353bd4e-cbab-4846-954a-acb4767788ac,host='devstack@QuobyteHD#QuobyteHD',id=44dd03c8-a58f-45d7-8d7d-4883ae9a8d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf73db6071e5432ca43db97f455dadaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:44Z,use_quota=True,user_id='32cb85d876724d21a6ef4a25dd23a94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(855f68d4-6e7d-4dec-a6e1-27229e8519db),volume_type_id=855f68d4-6e7d-4dec-a6e1-27229e8519db)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Creating volume 44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:21:43 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "cinder-2875bd34-7427-4005-b92c-7349ad39358e-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:43 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 1073741824 Jul 08 18:21:43 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-2875bd34-7427-4005-b92c-7349ad39358e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "cinder-quobyte-2875bd34-7427-4005-b92c-7349ad39358e" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-quobyte-2875bd34-7427-4005-b92c-7349ad39358e" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8ea93d-30a3-4d66-a5b6-5df637e37a8c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:44 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.978s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:44 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Deleted volume successfully. Jul 08 18:21:44 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e Jul 08 18:21:44 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-39cb5644-fcae-460c-8d41-55c43933916d tempest-VolumesCloneNegativeTest-1635189363 None] Lock "cinder-857a2cfb-e25f-4037-8892-d363eed94256-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:44 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 1073741824" returned: 0 in 1.059s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:45 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 Jul 08 18:21:45 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:45 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e" returned: 0 in 1.142s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:45 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e Jul 08 18:21:45 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:45 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26" returned: 0 in 0.783s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9bbbc8-60d6-47a0-853e-e30b6e9abc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db2f291-a529-4583-937a-723864ce5189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:45 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Volume volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 (44dd03c8-a58f-45d7-8d7d-4883ae9a8d26): created successfully Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db2f291-a529-4583-937a-723864ce5189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Flow 'volume_create_manager' (72dcbed2-b1b0-4a5a-817d-ea17c776bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-95ea111b-763b-4aa1-bb4b-2938dbefda5c tempest-GroupsTest-1062825123 None] Created volume successfully. Jul 08 18:21:45 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2875bd34-7427-4005-b92c-7349ad39358e" returned: 0 in 0.732s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-quobyte-2875bd34-7427-4005-b92c-7349ad39358e" released by "delete_volume" :: held 1.962s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Created reservations ['415f30bf-d1f8-4019-b7d3-87db95a4d31f', '48363fab-d9d2-445c-b22d-81ce2a7d7501', 'c0230279-c5e1-4345-9b9b-1985c58adc4a', '23a53037-fbe7-436a-bad2-8d8e9664f003'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:46 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:46 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9e668148-8e8a-4669-a304-4454dfd46ea8 tempest-GroupsTest-1062825123 None] Update group completed successfully. Jul 08 18:21:46 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.758s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Deleted volume successfully. Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-58dd3fbe-6daf-43b2-b228-03db8cf17645 tempest-VolumesSnapshotNegativeTestJSON-649601642 None] Lock "cinder-2875bd34-7427-4005-b92c-7349ad39358e-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:21:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Flow 'volume_create_manager' (1f87153f-52bf-49e9-8020-9fb7c86aa07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9ddeb6-ad31-48ae-81a5-d467e05e4560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9ddeb6-ad31-48ae-81a5-d467e05e4560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-617888644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f4bb6f-31f5-4f59-9853-d5a9f37f6e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f072939923d478badd0d865defd176c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:47Z,use_quota=True,user_id='fc5981019268480384ab7811b127d05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a308b0-db36-4da7-bdd4-8ee219400ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a308b0-db36-4da7-bdd4-8ee219400ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3deca074-675c-4768-93b2-926a82be873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3deca074-675c-4768-93b2-926a82be873e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f4bb6f-31f5-4f59-9853-d5a9f37f6e18', 'volume_name': 'volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cb8e82-fbca-41fc-a4aa-b5484a87a2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cb8e82-fbca-41fc-a4aa-b5484a87a2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e26e0a-dd9a-4026-8169-3055db36e9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:47 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Volume 91f4bb6f-31f5-4f59-9853-d5a9f37f6e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18', 'volume_size': 1} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-617888644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f4bb6f-31f5-4f59-9853-d5a9f37f6e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f072939923d478badd0d865defd176c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:21:47Z,use_quota=True,user_id='fc5981019268480384ab7811b127d05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Creating volume 91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:21:47 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:21:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:47 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 1073741824 Jul 08 18:21:47 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:48 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6eb9d577-2b58-4dd1-ad3d-b916587bbbd9 tempest-GroupsTest-1062825123 None] Update group completed successfully. Jul 08 18:21:48 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 1073741824" returned: 0 in 1.111s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:48 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 Jul 08 18:21:48 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:48 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" returned: 0 in 0.740s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:21:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e26e0a-dd9a-4026-8169-3055db36e9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf713a1-5b98-4e13-a55b-5ae12a1de726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:21:49 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Volume volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 (91f4bb6f-31f5-4f59-9853-d5a9f37f6e18): created successfully Jul 08 18:21:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf713a1-5b98-4e13-a55b-5ae12a1de726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:21:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Flow 'volume_create_manager' (1f87153f-52bf-49e9-8020-9fb7c86aa07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:21:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-d1224c13-f50e-46b5-8015-b5b478c991c5 req-10074363-d824-459a-a963-015e80d4b5d2 tempest-VolumesSnapshotsTestJSON-2119082824 None] Created volume successfully. Jul 08 18:21:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Creating offline snapshot effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 of volume 91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:21:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[399cfa56-e12c-44b1-9d4e-8fb7f114c759]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:49 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 Jul 08 18:21:49 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Acquiring lock "cinder-quobyte-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Lock "cinder-quobyte-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:50 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[307edc0b-6bd8-45b8-bb94-916fe61c29e1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:50 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 Jul 08 18:21:50 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:50 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" returned: 0 in 1.273s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:50 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 1G Jul 08 18:21:50 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:51 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26" returned: 0 in 0.964s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:51 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26 Jul 08 18:21:51 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:51 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 1G" returned: 0 in 1.130s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:52 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 Jul 08 18:21:52 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:52 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26" returned: 0 in 0.941s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Lock "cinder-quobyte-44dd03c8-a58f-45d7-8d7d-4883ae9a8d26" released by "delete_volume" :: held 1.975s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Acquiring lock "cinder-quobyte-95f909c4-904f-49c1-babb-ff1ac3f58c82" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Lock "cinder-quobyte-95f909c4-904f-49c1-babb-ff1ac3f58c82" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[783a2d8e-40d8-47b2-9e7e-632fa2fe6be0]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:52 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 Jul 08 18:21:52 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:53 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3" returned: 0 in 1.034s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:53 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 is being set with open permissions: ugo+rw Jul 08 18:21:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:53 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 Jul 08 18:21:53 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:53 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82" returned: 0 in 1.166s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:53 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82 Jul 08 18:21:53 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:54 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3" returned: 0 in 0.986s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:54 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.info Jul 08 18:21:54 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:54 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-95f909c4-904f-49c1-babb-ff1ac3f58c82" returned: 0 in 1.033s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Lock "cinder-quobyte-95f909c4-904f-49c1-babb-ff1ac3f58c82" released by "delete_volume" :: held 2.259s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Created reservations ['1f5fd513-5ab9-46ad-b76c-7161fee401f5'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:54 devstack cinder-volume[87309]: WARNING cinder.quota [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-88294555 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-88294555, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:21:54 devstack cinder-volume[87309]: WARNING cinder.quota [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-88294555 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-88294555, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Created reservations ['c1fd31df-f1bc-41b3-b4aa-ea5362007ebd', 'ae0a3147-10ca-4af2-b664-3a357032a918', '0701f2b5-3e17-4b55-95dc-1afff754e9f7', 'ff4633e9-a651-47b9-89e0-cbd27a1ffedc'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Created reservations ['cd32aae0-5bf0-4aa1-9d38-cc145111ecae', '0c3d09d8-3644-4f81-9a91-606b8b4724d5', '6830e0dd-8f60-4490-9620-1126a0eebc95', 'e6fc8e2f-3832-4a4a-aeea-4d11d52a8b70'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:54 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:21:54 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:54 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.info" returned: 0 in 0.861s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:54 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.info is being set with open permissions: ugo+rw Jul 08 18:21:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:54 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.info Jul 08 18:21:54 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:55 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.info" returned: 0 in 0.942s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.371s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:21:55 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-8a911d71-c201-4f56-a017-f2aa331f2094 req-2c9d17d0-7669-4129-833a-29e8c30ecf7e tempest-VolumesSnapshotsTestJSON-2119082824 None] Create snapshot completed successfully Jul 08 18:21:56 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.215s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:56 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:21:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-bf0e5f68-8841-44ed-9e9b-2adcd1179f13 tempest-GroupsTest-1062825123 None] Delete group completed successfully. Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "cinder-effc2105-f6d7-46ca-bf6a-7b128ce8a0d3-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-effc2105-f6d7-46ca-bf6a-7b128ce8a0d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "cinder-quobyte-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-quobyte-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "cinder-quobyte-effc2105-f6d7-46ca-bf6a-7b128ce8a0d3" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-quobyte-effc2105-f6d7-46ca-bf6a-7b128ce8a0d3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Deleting offline snapshot effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 of volume 91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] snapshot_file for this snap is: volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c6d76f-b85a-4a7f-adfc-ce11f3ed7326]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:57 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 Jul 08 18:21:57 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:58 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3" returned: 0 in 0.940s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:21:58 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[98372ec4-34d0-4ab2-9f5d-cf00414665e8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:21:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:58 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 Jul 08 18:21:58 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:21:59 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 08 18:21:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" returned: 0 in 0.915s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:21:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:21:59 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 Jul 08 18:21:59 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:00 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3" returned: 0 in 0.989s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:00 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3 Jul 08 18:22:00 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:01 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18.effc2105-f6d7-46ca-bf6a-7b128ce8a0d3" returned: 0 in 1.008s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-quobyte-effc2105-f6d7-46ca-bf6a-7b128ce8a0d3" released by "_delete_snapshot" :: held 4.029s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-quobyte-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" released by "delete_snapshot" :: held 4.070s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG cinder.quota [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Created reservations ['8581a78a-ade2-4885-aff7-49251205ecb9', '49bd566a-fe6d-490e-a1ef-a911d9541815', '70887eec-dc2e-4a9b-89c3-f6a9d51b14d9', '09e6d3d5-2e4f-4a4a-a0df-bb3dbefd0867'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Delete snapshot completed successfully. Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-3c90f5f2-160f-4b29-820c-8c34554977a7 req-9fb93a1d-5604-4b17-9ccd-31870cc9ad5c tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-effc2105-f6d7-46ca-bf6a-7b128ce8a0d3-delete_snapshot" released by "delete_snapshot" :: held 4.331s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "cinder-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "cinder-quobyte-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-quobyte-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab68272-6aa3-4e0a-84ba-c519ebf796ba]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:01 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 Jul 08 18:22:01 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:02 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:22:02 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:02 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" returned: 0 in 0.911s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:02 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18 Jul 08 18:22:02 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:03 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.928s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:22:03 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" returned: 0 in 0.874s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-quobyte-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18" released by "delete_volume" :: held 1.889s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG cinder.quota [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Created reservations ['0dd437e4-c139-4f46-a38d-fe340a68000e', '67ede881-f79a-4d0d-88d6-59a367c3cf67', '8ecb6117-109a-4d5d-bb21-09ad19b4f93b', '4bcab962-1458-4d5f-be35-1bdb441e5e12'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:03 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:22:03 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:04 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.191s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:04 devstack cinder-volume[87309]: DEBUG cinder.manager [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:22:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Deleted volume successfully. Jul 08 18:22:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-fbe25999-1fd5-42f7-8f5b-571de7951570 req-840d153f-b7b2-4e4b-a2b5-8a9ef914c474 tempest-VolumesSnapshotsTestJSON-2119082824 None] Lock "cinder-91f4bb6f-31f5-4f59-9853-d5a9f37f6e18-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:07 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3c28ffdf-e390-4e78-98ab-9fe3145bf98a tempest-GroupsV314Test-1130973412 None] Group tempest-GroupsV314Test-Group-1365925809: creating Jul 08 18:22:08 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3c28ffdf-e390-4e78-98ab-9fe3145bf98a tempest-GroupsV314Test-1130973412 None] Group tempest-GroupsV314Test-Group-1365925809: created successfully Jul 08 18:22:08 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3c28ffdf-e390-4e78-98ab-9fe3145bf98a tempest-GroupsV314Test-1130973412 None] Create group completed successfully. Jul 08 18:22:09 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Flow 'volume_create_manager' (5f4e983a-2faf-45b3-8109-2300b0c7fccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b572ab2-e533-488d-b15d-f6e7388e3437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b572ab2-e533-488d-b15d-f6e7388e3437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-304433490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6973d7b-a481-4dfc-8230-29b122afd103,host='devstack@QuobyteHD#QuobyteHD',id=c1a1a306-33a4-4d3f-817b-db6b1b23817d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24049c167b6d4cf295e4ead86cc27e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:10Z,use_quota=True,user_id='286ab54239bb471cb6e4ba6a4b7b19d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76fa4740-17d6-4626-9e88-4ddd85569387),volume_type_id=76fa4740-17d6-4626-9e88-4ddd85569387)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e771c3-13ba-4671-a1e1-9c815e74c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e771c3-13ba-4671-a1e1-9c815e74c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8d9e50-1231-4d22-933e-cdd78fe5e610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8d9e50-1231-4d22-933e-cdd78fe5e610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a1a306-33a4-4d3f-817b-db6b1b23817d', 'volume_name': 'volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51dd622-fe70-4d7b-90b4-ba0ce04626ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51dd622-fe70-4d7b-90b4-ba0ce04626ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f878074-8cdf-4327-87ac-3bc63555cce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:10 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Volume c1a1a306-33a4-4d3f-817b-db6b1b23817d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d', 'volume_size': 1} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e6973d7b-a481-4dfc-8230-29b122afd103,created_at=2026-07-08T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-304433490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6973d7b-a481-4dfc-8230-29b122afd103,host='devstack@QuobyteHD#QuobyteHD',id=c1a1a306-33a4-4d3f-817b-db6b1b23817d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24049c167b6d4cf295e4ead86cc27e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:10Z,use_quota=True,user_id='286ab54239bb471cb6e4ba6a4b7b19d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76fa4740-17d6-4626-9e88-4ddd85569387),volume_type_id=76fa4740-17d6-4626-9e88-4ddd85569387)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Creating volume c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:10 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:10 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d 1073741824 Jul 08 18:22:10 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:11 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Flow 'volume_create_manager' (ce27fa0f-c412-4f4a-b302-f0fcba1e6116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d430de-4d7d-4a61-bae2-04b0ba142c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d 1073741824" returned: 0 in 1.196s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=155,cinder:SELECT=119,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d430de-4d7d-4a61-bae2-04b0ba142c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2097327090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb31edaf-1cfc-4055-8710-e85f99991c44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fb8b74ce346478fa142988f6c98968f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:11Z,use_quota=True,user_id='4695340f544e43d195b980d586ddffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a004df8c-9ab0-4aa5-b267-326940aca351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a004df8c-9ab0-4aa5-b267-326940aca351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63742012-ff99-40ce-bdd3-707ac2c21e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63742012-ff99-40ce-bdd3-707ac2c21e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb31edaf-1cfc-4055-8710-e85f99991c44', 'volume_name': 'volume-cb31edaf-1cfc-4055-8710-e85f99991c44', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1847d6d-9177-499e-8ec5-3b08521f2c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1847d6d-9177-499e-8ec5-3b08521f2c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc6a7e6-73a0-435a-8ff7-a0c023b6a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:11 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Volume cb31edaf-1cfc-4055-8710-e85f99991c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb31edaf-1cfc-4055-8710-e85f99991c44', 'volume_size': 1} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:11 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d Jul 08 18:22:11 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:12 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d" returned: 0 in 0.703s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2097327090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb31edaf-1cfc-4055-8710-e85f99991c44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fb8b74ce346478fa142988f6c98968f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:11Z,use_quota=True,user_id='4695340f544e43d195b980d586ddffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Creating volume cb31edaf-1cfc-4055-8710-e85f99991c44 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:12 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f878074-8cdf-4327-87ac-3bc63555cce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:12 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 1073741824 Jul 08 18:22:12 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a6a69b-9e98-4f9f-a71f-cd17861476b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Volume volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d (c1a1a306-33a4-4d3f-817b-db6b1b23817d): created successfully Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a6a69b-9e98-4f9f-a71f-cd17861476b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Flow 'volume_create_manager' (5f4e983a-2faf-45b3-8109-2300b0c7fccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4b6460b6-9ee3-43ef-bc73-8ca9ea74b11e tempest-GroupsV314Test-1130973412 None] Created volume successfully. Jul 08 18:22:13 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 1073741824" returned: 0 in 1.211s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:13 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=129,cinder:INSERT=50,cinder:UPDATE=164,cinder:DELETE=9 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:22:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:13 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 Jul 08 18:22:13 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:14 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44" returned: 0 in 0.925s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.404s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:14 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Cloning volume c1a1a306-33a4-4d3f-817b-db6b1b23817d to volume 52aa7c0b-4d5d-45e5-b365-b843a8e039c9 Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc6a7e6-73a0-435a-8ff7-a0c023b6a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb31edaf-1cfc-4055-8710-e85f99991c44', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bebd124-5d7e-4136-b114-6f91dcd505d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:14 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Volume volume-cb31edaf-1cfc-4055-8710-e85f99991c44 (cb31edaf-1cfc-4055-8710-e85f99991c44): created successfully Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bebd124-5d7e-4136-b114-6f91dcd505d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Flow 'volume_create_manager' (ce27fa0f-c412-4f4a-b302-f0fcba1e6116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Creating offline snapshot e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 of volume c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:22:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f6ba24d2-caa1-4486-a2ae-efaa7ad7f679 tempest-VolumesTestJSON-1589148379 None] Created volume successfully. Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab033b-af19-4789-bf9a-69c5a5bfd73d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:14 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d Jul 08 18:22:14 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:15 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d" returned: 0 in 0.948s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:15 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 1G Jul 08 18:22:15 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Flow 'volume_create_manager' (c9b8edac-1b0e-460a-b8b5-c9399561ed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f3fc88-c554-41c7-b719-ebbdfd342e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f3fc88-c554-41c7-b719-ebbdfd342e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1656737432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2644d7-2696-4231-b531-a70ee1d7728c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fb8b74ce346478fa142988f6c98968f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:16Z,use_quota=True,user_id='4695340f544e43d195b980d586ddffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee04bc02-e07c-4552-8a2e-acaedaec408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee04bc02-e07c-4552-8a2e-acaedaec408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5311756e-a36d-4b0b-be87-386e163b07fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5311756e-a36d-4b0b-be87-386e163b07fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2644d7-2696-4231-b531-a70ee1d7728c', 'volume_name': 'volume-5b2644d7-2696-4231-b531-a70ee1d7728c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:16 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d35ef13-3a15-4f33-b750-784015029e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d35ef13-3a15-4f33-b750-784015029e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c141d17a-c0e5-4bfd-ac82-3bfe8f8e7c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:16 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Volume 5b2644d7-2696-4231-b531-a70ee1d7728c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2644d7-2696-4231-b531-a70ee1d7728c', 'volume_size': 1} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 1G" returned: 0 in 1.249s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:16 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 Jul 08 18:22:16 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:17 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" returned: 0 in 0.801s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:17 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:17 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 Jul 08 18:22:17 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Flow 'volume_create_manager' (ed9cafbc-7cc2-4baf-83f0-0da3447b7924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef2fb8b-db6d-4630-95de-bcf3b8886905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef2fb8b-db6d-4630-95de-bcf3b8886905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1614242632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69996024-2cab-4a03-a507-281f2d4ede13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501aad8c94964a5db8be2cfe898b1e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:18Z,use_quota=True,user_id='f71c921cad6648f7a75cca112ac0c96a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a709452-9541-4808-966d-9e1d094f54a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a709452-9541-4808-966d-9e1d094f54a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92640832-32b8-49f2-9e63-8e38123742ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92640832-32b8-49f2-9e63-8e38123742ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69996024-2cab-4a03-a507-281f2d4ede13', 'volume_name': 'volume-69996024-2cab-4a03-a507-281f2d4ede13', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358782a3-2f43-4e24-9f61-765beaa148d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358782a3-2f43-4e24-9f61-765beaa148d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516066a5-88a9-40b8-84f6-114163b0ad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:17 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Volume 69996024-2cab-4a03-a507-281f2d4ede13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69996024-2cab-4a03-a507-281f2d4ede13', 'volume_size': 1} Jul 08 18:22:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:18 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" returned: 0 in 0.822s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:18 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.info Jul 08 18:22:18 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:19 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.info" returned: 0 in 0.886s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:19 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:19 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.info Jul 08 18:22:19 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:19 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.info" returned: 0 in 0.726s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Acquiring lock "cinder-quobyte-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Lock "cinder-quobyte-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] snapshot: e9fde209-e4e4-4853-b1ad-7e0c1aac2a99, volume: 52aa7c0b-4d5d-45e5-b365-b843a8e039c9, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef74e967-bff7-4d78-9fb5-46eefe63aef5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:20 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 Jul 08 18:22:20 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:20 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:22:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:22:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:22:20 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e84d0f-bd57-4b49-9b08-bccf3c0a3084]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:20 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d Jul 08 18:22:20 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:21 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d" returned: 0 in 0.825s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:21 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:22:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:21 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 Jul 08 18:22:21 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:28 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=7,cinder:DELETE=2,cinder:SELECT=9,cinder:INSERT=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:22:28 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:22:28 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" returned: 0 in 6.741s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:28 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c3df2-51b2-4d0d-bce6-9dc34290d625]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:28 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d Jul 08 18:22:28 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:29 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d" returned: 0 in 1.061s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:29 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:22:29 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Converted 1024.00 MB image at 151.87 MB/s Jul 08 18:22:29 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:22:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:29 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 Jul 08 18:22:29 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:30 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" returned: 0 in 0.850s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Lock "cinder-quobyte-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" released by "_copy_volume_from_snapshot" :: held 10.414s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Acquiring lock "cinder-quobyte-e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Lock "cinder-quobyte-e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Deleting offline snapshot e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 of volume c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:22:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] snapshot_file for this snap is: volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:22:30 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2ba276-acd0-4dd2-bf4a-aef879beb423]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:30 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 Jul 08 18:22:30 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:31 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" returned: 0 in 1.075s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d948a00-7c8b-43b1-880f-3cf50f789245]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Flow 'volume_create_manager' (25e4a1d4-44e4-4ab0-8dbc-4eca5dc13537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304287d4-b920-49ad-bd63-2ec14d163d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304287d4-b920-49ad-bd63-2ec14d163d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1568090157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b999838-ce43-4bad-b41a-686f03c88cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a974f241b82d45a9b2cb8952a4a41bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:32Z,use_quota=True,user_id='6035de9ef0cc4d638275b237379dd5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f3da00-b1b5-4d3f-ad6e-f549a72b1013),volume_type_id=98f3da00-b1b5-4d3f-ad6e-f549a72b1013)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:31 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e890baa-7ebd-4889-b443-ff833bc7ea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:31 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e890baa-7ebd-4889-b443-ff833bc7ea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6cc74c-696f-4f47-968c-d8cd61d7541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6cc74c-696f-4f47-968c-d8cd61d7541b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b999838-ce43-4bad-b41a-686f03c88cdf', 'volume_name': 'volume-1b999838-ce43-4bad-b41a-686f03c88cdf', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7189c5f7-b480-41ef-be1e-38ebe74d77fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7189c5f7-b480-41ef-be1e-38ebe74d77fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a16b808-35c4-493c-ad7f-2ebaedba5fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:31 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume 1b999838-ce43-4bad-b41a-686f03c88cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b999838-ce43-4bad-b41a-686f03c88cdf', 'volume_size': 1} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Flow 'volume_create_manager' (3e731eb4-2c73-41cb-bda7-e7bed7074e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6c125c-2ec5-4b40-a618-6922ebf2b723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6c125c-2ec5-4b40-a618-6922ebf2b723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1414829476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a974f241b82d45a9b2cb8952a4a41bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:32Z,use_quota=True,user_id='6035de9ef0cc4d638275b237379dd5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bad78d6d-c95f-433d-a5d9-25aea28e1d84),volume_type_id=bad78d6d-c95f-433d-a5d9-25aea28e1d84)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45a2df1-1e63-4983-98b9-5d3673f7df54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45a2df1-1e63-4983-98b9-5d3673f7df54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f445d690-7c3a-4aa1-8ab7-fbd753ffa927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f445d690-7c3a-4aa1-8ab7-fbd753ffa927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d', 'volume_name': 'volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851c4a8c-3f99-45ca-9636-b20cb454b358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851c4a8c-3f99-45ca-9636-b20cb454b358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bde806b-b343-456f-b832-5759c27a82f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume 8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d', 'volume_size': 1} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:32 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d" returned: 0 in 0.932s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:32 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 Jul 08 18:22:32 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Flow 'volume_create_manager' (c02956f9-1fe6-414a-af86-d621256d09bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663a8c27-2a82-4beb-b9a8-64e4620657db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663a8c27-2a82-4beb-b9a8-64e4620657db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-649349737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9959bd1-cece-40c2-98d3-2bf64ddf5a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a974f241b82d45a9b2cb8952a4a41bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:33Z,use_quota=True,user_id='6035de9ef0cc4d638275b237379dd5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9caa8da0-dbdd-4dda-ae70-7b8b012ad5f5),volume_type_id=9caa8da0-dbdd-4dda-ae70-7b8b012ad5f5)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f18383-856a-4583-a3a9-ee4eb37eff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f18383-856a-4583-a3a9-ee4eb37eff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631f4ebf-e387-4afe-b25a-04595fedb4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631f4ebf-e387-4afe-b25a-04595fedb4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9959bd1-cece-40c2-98d3-2bf64ddf5a70', 'volume_name': 'volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70', 'volume_size': 1, 'image_id': '8233117e-36a2-45ca-a543-de9e59a338d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8233117e-36a2-45ca-a543-de9e59a338d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1263504607', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a974f241b82d45a9b2cb8952a4a41bf3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8233117e-36a2-45ca-a543-de9e59a338d0', 'created_at': datetime.datetime(2026, 7, 8, 16, 22, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 22, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8233117e-36a2-45ca-a543-de9e59a338d0/file', 'properties': {}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3a03f1-7258-4d96-b398-1191ea3268d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3a03f1-7258-4d96-b398-1191ea3268d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664fdc55-9b40-4093-ab46-8080021de902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:32 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume f9959bd1-cece-40c2-98d3-2bf64ddf5a70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70', 'volume_size': 1, 'image_id': '8233117e-36a2-45ca-a543-de9e59a338d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8233117e-36a2-45ca-a543-de9e59a338d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1263504607', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a974f241b82d45a9b2cb8952a4a41bf3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8233117e-36a2-45ca-a543-de9e59a338d0', 'created_at': datetime.datetime(2026, 7, 8, 16, 22, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 22, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8233117e-36a2-45ca-a543-de9e59a338d0/file', 'properties': {}}, 'image_service': } Jul 08 18:22:32 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Trying to clone f9959bd1-cece-40c2-98d3-2bf64ddf5a70 from image 8233117e-36a2-45ca-a543-de9e59a338d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8233117e-36a2-45ca-a543-de9e59a338d0', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:22:33 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" returned: 0 in 0.779s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:33 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99 Jul 08 18:22:33 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:33 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d.e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" returned: 0 in 0.688s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Lock "cinder-quobyte-e9fde209-e4e4-4853-b1ad-7e0c1aac2a99" released by "_delete_snapshot" :: held 3.591s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.706s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.397s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1656737432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2644d7-2696-4231-b531-a70ee1d7728c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fb8b74ce346478fa142988f6c98968f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:16Z,use_quota=True,user_id='4695340f544e43d195b980d586ddffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Creating volume 5b2644d7-2696-4231-b531-a70ee1d7728c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:33 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:34 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c 1073741824 Jul 08 18:22:34 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:34 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-35c22dfb-fee0-4297-9eac-931ab123940f tempest-GroupsV314Test-1130973412 None] Create group from source-group-e6973d7b-a481-4dfc-8230-29b122afd103 completed successfully. Jul 08 18:22:35 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c 1073741824" returned: 0 in 1.065s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:35 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c Jul 08 18:22:35 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Acquiring lock "cinder-quobyte-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Lock "cinder-quobyte-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[835657fd-19f7-42f4-8ad0-2ad4d1ff20e5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:35 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 Jul 08 18:22:35 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:35 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c" returned: 0 in 0.868s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.089s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1614242632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69996024-2cab-4a03-a507-281f2d4ede13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501aad8c94964a5db8be2cfe898b1e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:18Z,use_quota=True,user_id='f71c921cad6648f7a75cca112ac0c96a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Creating volume 69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:35 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:35 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 1073741824 Jul 08 18:22:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c141d17a-c0e5-4bfd-ac82-3bfe8f8e7c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2644d7-2696-4231-b531-a70ee1d7728c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:35 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd10bb8-8848-4297-8131-df71821fc62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:36 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Volume volume-5b2644d7-2696-4231-b531-a70ee1d7728c (5b2644d7-2696-4231-b531-a70ee1d7728c): created successfully Jul 08 18:22:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd10bb8-8848-4297-8131-df71821fc62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Flow 'volume_create_manager' (c9b8edac-1b0e-460a-b8b5-c9399561ed9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7727b903-61d2-4c25-8601-bd4af80f3e5e tempest-VolumesTestJSON-1589148379 None] Created volume successfully. Jul 08 18:22:36 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" returned: 0 in 0.918s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:36 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9 Jul 08 18:22:36 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD, size 20.69 MB, duration 4.33 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:22:37 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Image download 20.69 MB at 4.78 MB/s Jul 08 18:22:37 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 1073741824" returned: 0 in 1.419s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[189b6876-297b-447a-a73c-c4df9bb3ea94]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:37 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" returned: 0 in 1.029s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Lock "cinder-quobyte-52aa7c0b-4d5d-45e5-b365-b843a8e039c9" released by "delete_volume" :: held 2.021s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:37 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 Jul 08 18:22:37 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Created reservations ['a826b0a9-7f89-45cf-8c95-324b41c37070'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:37 devstack cinder-volume[87309]: WARNING cinder.quota [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-498749144 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-498749144, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:22:37 devstack cinder-volume[87309]: WARNING cinder.quota [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-498749144 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-498749144, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:22:37 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD Jul 08 18:22:37 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:37 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Created reservations ['d0ba1368-eb55-46ac-ad11-2793aa5982d7', '799e38fd-9967-4f62-9019-b7f236c88083', '129e801b-11a7-4132-8866-46bcdce3fd7d', 'c4837c53-da9d-415f-86c1-fe5dabf55a04'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Flow 'volume_create_manager' (577755c6-117c-4734-a075-c0b1e9516c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c013c08b-3ae2-485b-ab56-b1c029668e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c013c08b-3ae2-485b-ab56-b1c029668e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-449313003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d36cda-d326-4a4a-a566-9300e13cb198,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fb8b74ce346478fa142988f6c98968f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:38Z,use_quota=True,user_id='4695340f544e43d195b980d586ddffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a7ad71-5f5c-4306-8849-f58758b92cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a7ad71-5f5c-4306-8849-f58758b92cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc953f2-e016-4e21-a67a-f9f50d8fadb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc953f2-e016-4e21-a67a-f9f50d8fadb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d36cda-d326-4a4a-a566-9300e13cb198', 'volume_name': 'volume-d0d36cda-d326-4a4a-a566-9300e13cb198', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16689af4-1bdb-4931-8743-0dde9ea0e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16689af4-1bdb-4931-8743-0dde9ea0e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8400bcc4-d268-437a-8488-94f2d6799aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Volume d0d36cda-d326-4a4a-a566-9300e13cb198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d36cda-d326-4a4a-a566-9300e13cb198', 'volume_size': 1} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:38 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:22:38 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:38 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13" returned: 0 in 1.030s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] <== create_volume: return (2577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.581s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.848s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1568090157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b999838-ce43-4bad-b41a-686f03c88cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a974f241b82d45a9b2cb8952a4a41bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:32Z,use_quota=True,user_id='6035de9ef0cc4d638275b237379dd5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f3da00-b1b5-4d3f-ad6e-f549a72b1013),volume_type_id=98f3da00-b1b5-4d3f-ad6e-f549a72b1013)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Creating volume 1b999838-ce43-4bad-b41a-686f03c88cdf {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:38 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516066a5-88a9-40b8-84f6-114163b0ad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69996024-2cab-4a03-a507-281f2d4ede13', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:38 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf 1073741824 Jul 08 18:22:38 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb23458-580d-40db-af56-b8eb31f82348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:38 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD" returned: 0 in 1.167s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Temporary image 8233117e-36a2-45ca-a543-de9e59a338d0 is fetched for user 6035de9ef0cc4d638275b237379dd5a9. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:22:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Volume volume-69996024-2cab-4a03-a507-281f2d4ede13 (69996024-2cab-4a03-a507-281f2d4ede13): created successfully Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb23458-580d-40db-af56-b8eb31f82348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Flow 'volume_create_manager' (ed9cafbc-7cc2-4baf-83f0-0da3447b7924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3a698cd6-e725-43bb-a460-c82ada04711b tempest-TestStampPattern-640461682 None] Created volume successfully. Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d05de37-a9b1-4feb-981d-c2051e10bb82]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:38 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD Jul 08 18:22:38 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:38 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.726s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:38 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:22:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4026af0a-e000-4e86-83f3-d95c7bf04d4e tempest-GroupsV314Test-1130973412 None] Delete group completed successfully. Jul 08 18:22:39 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Acquiring lock "cinder-quobyte-c1a1a306-33a4-4d3f-817b-db6b1b23817d" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:39 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf 1073741824" returned: 0 in 1.013s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Lock "cinder-quobyte-c1a1a306-33a4-4d3f-817b-db6b1b23817d" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:39 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd8335-6f49-4303-92f8-db799349ccb7]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:39 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf Jul 08 18:22:39 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:39 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d Jul 08 18:22:39 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:40 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf" returned: 0 in 0.838s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.445s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1414829476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a974f241b82d45a9b2cb8952a4a41bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:32Z,use_quota=True,user_id='6035de9ef0cc4d638275b237379dd5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bad78d6d-c95f-433d-a5d9-25aea28e1d84),volume_type_id=bad78d6d-c95f-433d-a5d9-25aea28e1d84)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Creating volume 8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:40 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:40 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d 1073741824 Jul 08 18:22:40 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a16b808-35c4-493c-ad7f-2ebaedba5fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b999838-ce43-4bad-b41a-686f03c88cdf', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81abd04e-7301-4853-84d0-dbfce553c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:40 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume volume-1b999838-ce43-4bad-b41a-686f03c88cdf (1b999838-ce43-4bad-b41a-686f03c88cdf): created successfully Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81abd04e-7301-4853-84d0-dbfce553c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Flow 'volume_create_manager' (25e4a1d4-44e4-4ab0-8dbc-4eca5dc13537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-64bf0231-8b9b-4467-a4a0-c24829846176 tempest-TestInstancesWithCinderVolumes-1599322074 None] Created volume successfully. Jul 08 18:22:40 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d" returned: 0 in 1.016s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:40 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d Jul 08 18:22:40 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:41 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a1a306-33a4-4d3f-817b-db6b1b23817d" returned: 0 in 0.710s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Lock "cinder-quobyte-c1a1a306-33a4-4d3f-817b-db6b1b23817d" released by "delete_volume" :: held 1.816s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Created reservations ['8b1dfae2-a204-4b91-b28b-f99df9d454fc'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Created reservations ['5e82f8e9-43be-432d-81e7-8938ca60e143', '0ea9d5bd-df6d-4aad-aa6b-f21d2822088b', '8795649d-3b81-4b20-a8f7-892f2d7b1e73', 'a2a8a7c2-3282-41e3-a298-4643a61f19f4'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:41 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d 1073741824" returned: 0 in 1.050s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:41 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d Jul 08 18:22:41 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:41 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:22:41 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:42 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d" returned: 0 in 1.110s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.601s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-449313003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d36cda-d326-4a4a-a566-9300e13cb198,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fb8b74ce346478fa142988f6c98968f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:38Z,use_quota=True,user_id='4695340f544e43d195b980d586ddffe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Creating volume d0d36cda-d326-4a4a-a566-9300e13cb198 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:42 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bde806b-b343-456f-b832-5759c27a82f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:42 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 1073741824 Jul 08 18:22:42 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276ff246-aae1-4fb8-b7f4-1fecb5437672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:42 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d (8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d): created successfully Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276ff246-aae1-4fb8-b7f4-1fecb5437672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Flow 'volume_create_manager' (3e731eb4-2c73-41cb-bda7-e7bed7074e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-871d4a86-f68b-46d3-91dd-4825d56c6a6b tempest-TestInstancesWithCinderVolumes-1599322074 None] Created volume successfully. Jul 08 18:22:42 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.248s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:42 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:22:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-22e4f35a-c187-49ce-8742-c33f497e6798 tempest-GroupsV314Test-1130973412 None] Delete group completed successfully. Jul 08 18:22:43 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 1073741824" returned: 0 in 1.150s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:43 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 Jul 08 18:22:43 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:44 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198" returned: 0 in 0.921s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.323s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-649349737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9959bd1-cece-40c2-98d3-2bf64ddf5a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a974f241b82d45a9b2cb8952a4a41bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:22:33Z,use_quota=True,user_id='6035de9ef0cc4d638275b237379dd5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9caa8da0-dbdd-4dda-ae70-7b8b012ad5f5),volume_type_id=9caa8da0-dbdd-4dda-ae70-7b8b012ad5f5)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Creating volume f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:44 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8400bcc4-d268-437a-8488-94f2d6799aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d36cda-d326-4a4a-a566-9300e13cb198', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3da8e9-8ae4-4f35-a76e-6dd5b5643035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:44 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Volume volume-d0d36cda-d326-4a4a-a566-9300e13cb198 (d0d36cda-d326-4a4a-a566-9300e13cb198): created successfully Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3da8e9-8ae4-4f35-a76e-6dd5b5643035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:44 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 1073741824 Jul 08 18:22:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Flow 'volume_create_manager' (577755c6-117c-4734-a075-c0b1e9516c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:44 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e6d814b5-0bc9-4ca5-b952-6cedeab7abbf tempest-VolumesTestJSON-1589148379 None] Created volume successfully. Jul 08 18:22:46 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 1073741824" returned: 0 in 1.348s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:46 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:22:46 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Acquiring lock "cinder-d0d36cda-d326-4a4a-a566-9300e13cb198-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Lock "cinder-d0d36cda-d326-4a4a-a566-9300e13cb198-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Acquiring lock "cinder-quobyte-d0d36cda-d326-4a4a-a566-9300e13cb198" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Lock "cinder-quobyte-d0d36cda-d326-4a4a-a566-9300e13cb198" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7533b3b-a7b3-44ff-b202-9b318ead0612]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:47 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 0 in 1.108s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] <== create_volume: return (2516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.520s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Attempting download of 8233117e-36a2-45ca-a543-de9e59a338d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/8233117e-36a2-45ca-a543-de9e59a338d0', 'metadata': {}}])) to volume f9959bd1-cece-40c2-98d3-2bf64ddf5a70. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:22:47 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 Jul 08 18:22:47 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3c97fc-0e4f-45d1-b44e-178674487017]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8233117e-36a2-45ca-a543-de9e59a338d0_tqp4uncs {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:47 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8233117e-36a2-45ca-a543-de9e59a338d0_tqp4uncs Jul 08 18:22:47 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:48 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198" returned: 0 in 0.979s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:48 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198 Jul 08 18:22:48 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:48 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8233117e-36a2-45ca-a543-de9e59a338d0_tqp4uncs" returned: 0 in 0.932s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8233117e-36a2-45ca-a543-de9e59a338d0_tqp4uncs {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:48 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8233117e-36a2-45ca-a543-de9e59a338d0_tqp4uncs Jul 08 18:22:48 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:48 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d0d36cda-d326-4a4a-a566-9300e13cb198" returned: 0 in 0.729s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Lock "cinder-quobyte-d0d36cda-d326-4a4a-a566-9300e13cb198" released by "delete_volume" :: held 1.766s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Created reservations ['af9bb715-1c4b-4b12-9783-6649da1cb0f9', '1c4b12c3-ac2d-43fe-b4c7-fa35f4fc302e', 'df0bb0f1-38a3-42e3-9228-a8497ec816b1', 'e4f0a6f9-c74b-45d0-b9ee-09ec1bab4c50'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:49 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:22:49 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:49 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8233117e-36a2-45ca-a543-de9e59a338d0_tqp4uncs" returned: 1 in 0.873s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8233117e-36a2-45ca-a543-de9e59a338d0_tqp4uncs' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d0e4f-304b-4e58-a6c4-6c778f7e1300]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-41a67f1c-01a1-4538-bca4-d6c1fa626f3c tempest-GroupsV320Test-1887876533 None] Group tempest-GroupsV320Test-Group-1660298870: creating Jul 08 18:22:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-41a67f1c-01a1-4538-bca4-d6c1fa626f3c tempest-GroupsV320Test-1887876533 None] Group tempest-GroupsV320Test-Group-1660298870: created successfully Jul 08 18:22:49 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD Jul 08 18:22:49 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-41a67f1c-01a1-4538-bca4-d6c1fa626f3c tempest-GroupsV320Test-1887876533 None] Create group completed successfully. Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Acquiring lock "cinder-5b2644d7-2696-4231-b531-a70ee1d7728c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Lock "cinder-5b2644d7-2696-4231-b531-a70ee1d7728c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Acquiring lock "cinder-quobyte-5b2644d7-2696-4231-b531-a70ee1d7728c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Lock "cinder-quobyte-5b2644d7-2696-4231-b531-a70ee1d7728c" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[358e123e-2f56-430f-be01-d4b53032f389]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:49 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c Jul 08 18:22:49 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:50 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.932s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:50 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:22:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Deleted volume successfully. Jul 08 18:22:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e20e57d2-954a-4eaf-880b-290714e34d99 tempest-VolumesTestJSON-1589148379 None] Lock "cinder-d0d36cda-d326-4a4a-a566-9300e13cb198-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:50 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:50 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] 8233117e-36a2-45ca-a543-de9e59a338d0 was qcow2, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:22:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:50 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:22:50 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:50 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c" returned: 0 in 0.981s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:50 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c Jul 08 18:22:50 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Created reservations ['3859090b-f16c-4b62-81cd-51a652f9fe20'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:51 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:22:51 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:51 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5b2644d7-2696-4231-b531-a70ee1d7728c" returned: 0 in 0.962s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Lock "cinder-quobyte-5b2644d7-2696-4231-b531-a70ee1d7728c" released by "delete_volume" :: held 2.008s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Created reservations ['868f372b-52c7-4a6f-a791-a91ba8187605', '07068abe-16f5-46df-814b-6bc5c0074da0', '98bfb827-4694-4a48-bb84-62760653cc99', 'ebe35187-3001-4a34-a658-204a9631321f'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:51 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:22:51 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Acquiring lock "cinder-cb31edaf-1cfc-4055-8710-e85f99991c44-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Lock "cinder-cb31edaf-1cfc-4055-8710-e85f99991c44-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Acquiring lock "cinder-quobyte-cb31edaf-1cfc-4055-8710-e85f99991c44" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Lock "cinder-quobyte-cb31edaf-1cfc-4055-8710-e85f99991c44" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73975f5-ccc9-45e5-aa65-d5509c7c12e4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:52 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.007s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:22:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5a9bbbec-1f92-4e13-8b5a-f9c289eee619 tempest-GroupsV320Test-1887876533 None] Delete group completed successfully. Jul 08 18:22:52 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 Jul 08 18:22:52 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:52 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.974s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:22:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Deleted volume successfully. Jul 08 18:22:52 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1774961d-62bc-4935-b033-2411423591fa tempest-VolumesTestJSON-1589148379 None] Lock "cinder-5b2644d7-2696-4231-b531-a70ee1d7728c-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 0 in 2.561s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8233117e-36a2-45ca-a543-de9e59a338d0_sss1690gdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:22:52 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Converted 112.00 MB image at 43.73 MB/s Jul 08 18:22:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:52 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 1G Jul 08 18:22:52 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:53 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44" returned: 0 in 0.966s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:53 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44 Jul 08 18:22:53 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:53 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 1G" returned: 0 in 0.838s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:53 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59b0843-79f5-4831-bdcc-a464293e4a80]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:22:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:53 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:22:53 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:53 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cb31edaf-1cfc-4055-8710-e85f99991c44" returned: 0 in 0.756s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Lock "cinder-quobyte-cb31edaf-1cfc-4055-8710-e85f99991c44" released by "delete_volume" :: held 1.788s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:53 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Created reservations ['ee0a49eb-278f-46b6-bd34-505ee907a550', 'ca1610f7-ba85-4e7e-8281-836d6bf2e122', '4a5dce81-20d4-43bd-8912-014a7728885d', 'f61fadc4-0151-4a94-829e-7643ba42ceb1'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:54 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:22:54 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:54 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 0 in 0.975s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:22:54 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:22:54 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:22:54 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.821s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:22:54 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Deleted volume successfully. Jul 08 18:22:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c7f9ec01-1817-45bc-9074-5fad6bd81003 tempest-VolumesTestJSON-1589148379 None] Lock "cinder-cb31edaf-1cfc-4055-8710-e85f99991c44-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:22:55 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 1 in 1.023s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Downloaded image 8233117e-36a2-45ca-a543-de9e59a338d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/8233117e-36a2-45ca-a543-de9e59a338d0', 'metadata': {}}])) to volume f9959bd1-cece-40c2-98d3-2bf64ddf5a70 successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Temporary image 8233117e-36a2-45ca-a543-de9e59a338d0 for user 6035de9ef0cc4d638275b237379dd5a9 is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Marking volume f9959bd1-cece-40c2-98d3-2bf64ddf5a70 as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Copying metadata from image 8233117e-36a2-45ca-a543-de9e59a338d0 to f9959bd1-cece-40c2-98d3-2bf64ddf5a70. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Creating volume glance metadata for volume f9959bd1-cece-40c2-98d3-2bf64ddf5a70 backed by image 8233117e-36a2-45ca-a543-de9e59a338d0 with: {'image_id': '8233117e-36a2-45ca-a543-de9e59a338d0', 'image_name': 'tempest-scenario-img--1263504607', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664fdc55-9b40-4093-ab46-8080021de902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70', 'volume_size': 1, 'image_id': '8233117e-36a2-45ca-a543-de9e59a338d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8233117e-36a2-45ca-a543-de9e59a338d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1263504607', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a974f241b82d45a9b2cb8952a4a41bf3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8233117e-36a2-45ca-a543-de9e59a338d0', 'created_at': datetime.datetime(2026, 7, 8, 16, 22, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 22, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8233117e-36a2-45ca-a543-de9e59a338d0/file', 'properties': {}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940512d3-eb91-441d-b260-132bfaa32687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:55 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Volume volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 (f9959bd1-cece-40c2-98d3-2bf64ddf5a70): created successfully Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940512d3-eb91-441d-b260-132bfaa32687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Flow 'volume_create_manager' (c02956f9-1fe6-414a-af86-d621256d09bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:55 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-02dca222-f4ee-4851-aa11-220a2493c64b tempest-TestInstancesWithCinderVolumes-1599322074 None] Created volume successfully. Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6bc66079-492f-46b5-b0ac-14980a1d82db tempest-BackendsCapabilitiesAdminTestsJSON-684125955 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87309) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Flow 'volume_create_manager' (99fd0fea-94e7-478c-8c6b-2bd8b13fb6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9f9c68-6f8f-4942-b69d-5dbb250a6397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9f9c68-6f8f-4942-b69d-5dbb250a6397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1441747612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8278790f-de37-4b5e-8cd3-a4be823e21f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217cafb78ae34283b60d545813883b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:00Z,use_quota=True,user_id='ae1a370c43534c39ae201e91813d9a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6afcc1-c60f-4532-aaf2-1f0353a02e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6afcc1-c60f-4532-aaf2-1f0353a02e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb99fc6f-9537-411a-b783-5304958baf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb99fc6f-9537-411a-b783-5304958baf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8278790f-de37-4b5e-8cd3-a4be823e21f0', 'volume_name': 'volume-8278790f-de37-4b5e-8cd3-a4be823e21f0', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639ac78d-b1ea-4080-8cd7-8c05692f8bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639ac78d-b1ea-4080-8cd7-8c05692f8bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b30f15-674d-4dc3-9577-3b14d5e689aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:22:59 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Volume 8278790f-de37-4b5e-8cd3-a4be823e21f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8278790f-de37-4b5e-8cd3-a4be823e21f0', 'volume_size': 1} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1441747612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8278790f-de37-4b5e-8cd3-a4be823e21f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217cafb78ae34283b60d545813883b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:00Z,use_quota=True,user_id='ae1a370c43534c39ae201e91813d9a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Creating volume 8278790f-de37-4b5e-8cd3-a4be823e21f0 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:22:59 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:22:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9e892b21-38d8-4c0a-8a14-18ca48db32a0 tempest-BackendsCapabilitiesAdminTestsJSON-684125955 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87309) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 18:23:00 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 1073741824 Jul 08 18:23:00 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:00 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 1073741824" returned: 0 in 0.864s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:00 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 Jul 08 18:23:00 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:01 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0" returned: 0 in 0.666s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:23:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b30f15-674d-4dc3-9577-3b14d5e689aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8278790f-de37-4b5e-8cd3-a4be823e21f0', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d21ac6-c1cb-41e7-bbc6-89b95e45eda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:01 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Volume volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 (8278790f-de37-4b5e-8cd3-a4be823e21f0): created successfully Jul 08 18:23:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d21ac6-c1cb-41e7-bbc6-89b95e45eda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Flow 'volume_create_manager' (99fd0fea-94e7-478c-8c6b-2bd8b13fb6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1a4c33e1-1ed4-4e6b-ab46-beb9c90519af tempest-VolumeQuotasAdminTestJSON-2076389259 None] Created volume successfully. Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Acquiring lock "cinder-8278790f-de37-4b5e-8cd3-a4be823e21f0-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "cinder-8278790f-de37-4b5e-8cd3-a4be823e21f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Acquiring lock "cinder-quobyte-8278790f-de37-4b5e-8cd3-a4be823e21f0" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "cinder-quobyte-8278790f-de37-4b5e-8cd3-a4be823e21f0" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[371dfb52-bf04-4b33-9a12-ad50318d0921]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:02 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 Jul 08 18:23:02 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:02 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:23:02 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:03 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.804s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:23:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:23:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:23:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:23:03 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0" returned: 0 in 0.997s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:03 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0 Jul 08 18:23:03 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:04 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8278790f-de37-4b5e-8cd3-a4be823e21f0" returned: 0 in 0.783s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "cinder-quobyte-8278790f-de37-4b5e-8cd3-a4be823e21f0" released by "delete_volume" :: held 1.830s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Created reservations ['02ed6bfe-c8b5-405a-ab1b-44c7f9c17b81', '52352d59-9784-4f4c-9279-57f88837a6a2', '15dd7f5d-5d2c-414d-ad5d-56e1f15845a0', '81cb3a7e-6e20-454e-b0ee-4bfe71f0239f'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:04 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:23:04 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f5874a-7e0a-4e5f-9c1b-bb578355f88b]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:05 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:23:05 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:23:05 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Flow 'volume_create_manager' (eb20e123-a4f6-4bf4-8a4f-0a8433b04f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7148c6-ad13-41c2-b625-1ed1e24af536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.381s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:23:05 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Deleted volume successfully. Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7148c6-ad13-41c2-b625-1ed1e24af536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1775836769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7d1275-6f62-40cb-8c48-76daf6c1a9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217cafb78ae34283b60d545813883b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:05Z,use_quota=True,user_id='ae1a370c43534c39ae201e91813d9a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c24f38f-424a-469d-8470-eed65d921816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c24f38f-424a-469d-8470-eed65d921816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b3fa0d-612f-44fd-ae72-cbc4d13fc675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b3fa0d-612f-44fd-ae72-cbc4d13fc675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7d1275-6f62-40cb-8c48-76daf6c1a9fe', 'volume_name': 'volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a563f074-9614-44d8-82e7-3870591c7647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a563f074-9614-44d8-82e7-3870591c7647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113d90b1-a5ef-4d34-a2b9-b26d1b84eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Volume dc7d1275-6f62-40cb-8c48-76daf6c1a9fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe', 'volume_size': 1} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d55a33fd-4dc6-4087-a893-07a7d5659d2b tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "cinder-8278790f-de37-4b5e-8cd3-a4be823e21f0-delete_volume" released by "delete_volume" :: held 3.805s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:06 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 0 in 1.265s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:06 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:23:06 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8907638a-1d51-4695-9bf3-1ea3b8a93068 tempest-GroupSnapshotsTest-846799256 None] Group tempest-GroupSnapshotsTest-Group-1364687927: creating Jul 08 18:23:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8907638a-1d51-4695-9bf3-1ea3b8a93068 tempest-GroupSnapshotsTest-846799256 None] Group tempest-GroupSnapshotsTest-Group-1364687927: created successfully Jul 08 18:23:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8907638a-1d51-4695-9bf3-1ea3b8a93068 tempest-GroupSnapshotsTest-846799256 None] Create group completed successfully. Jul 08 18:23:07 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 1 in 0.835s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.176s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1775836769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7d1275-6f62-40cb-8c48-76daf6c1a9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217cafb78ae34283b60d545813883b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:05Z,use_quota=True,user_id='ae1a370c43534c39ae201e91813d9a77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Creating volume dc7d1275-6f62-40cb-8c48-76daf6c1a9fe {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:23:07 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:07 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe 1073741824 Jul 08 18:23:07 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2729e49-3acc-4156-a7c4-072991147bf5', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:23:07 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-1cf02223-26b5-4dbe-90d6-38469e202aba req-74c45b8f-0d96-40aa-b395-3787a7185ae3 tempest-TestInstancesWithCinderVolumes-1599322074 None] attachment_update completed successfully. Jul 08 18:23:08 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe 1073741824" returned: 0 in 0.934s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:08 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe Jul 08 18:23:08 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Flow 'volume_create_manager' (0201b431-4bca-460d-892a-c9dd4819337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4f40b1-6d9d-4c93-b993-45e93d1b6048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4f40b1-6d9d-4c93-b993-45e93d1b6048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-549976605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d5530c9-955d-4e26-aa3f-4c0632432400,host='devstack@QuobyteHD#QuobyteHD',id=a666267a-452d-4afd-9e31-84a6a7c4fc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648278fe867c4d19a1b99de7145a1104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:09Z,use_quota=True,user_id='b34ff75932924328b4c84f307de80fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14b0757e-45bc-44ca-b161-14758fb65e5c),volume_type_id=14b0757e-45bc-44ca-b161-14758fb65e5c)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50d074f-3b13-4998-aeb5-19890a447b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50d074f-3b13-4998-aeb5-19890a447b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e49ef73-e635-420e-9164-6dea2dcd3985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e49ef73-e635-420e-9164-6dea2dcd3985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a666267a-452d-4afd-9e31-84a6a7c4fc65', 'volume_name': 'volume-a666267a-452d-4afd-9e31-84a6a7c4fc65', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853eefaf-7dec-47c6-9a32-376ed18dbaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853eefaf-7dec-47c6-9a32-376ed18dbaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe5e52a-68e8-4107-a231-74f858be181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:08 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Volume a666267a-452d-4afd-9e31-84a6a7c4fc65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a666267a-452d-4afd-9e31-84a6a7c4fc65', 'volume_size': 1} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:08 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe" returned: 0 in 0.765s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d5530c9-955d-4e26-aa3f-4c0632432400,created_at=2026-07-08T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-549976605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d5530c9-955d-4e26-aa3f-4c0632432400,host='devstack@QuobyteHD#QuobyteHD',id=a666267a-452d-4afd-9e31-84a6a7c4fc65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648278fe867c4d19a1b99de7145a1104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:09Z,use_quota=True,user_id='b34ff75932924328b4c84f307de80fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14b0757e-45bc-44ca-b161-14758fb65e5c),volume_type_id=14b0757e-45bc-44ca-b161-14758fb65e5c)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Creating volume a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:23:08 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:08 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 1073741824 Jul 08 18:23:08 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113d90b1-a5ef-4d34-a2b9-b26d1b84eff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128cf85b-5650-4eaf-85b6-bfa02dbda5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:08 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Volume volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe (dc7d1275-6f62-40cb-8c48-76daf6c1a9fe): created successfully Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128cf85b-5650-4eaf-85b6-bfa02dbda5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Flow 'volume_create_manager' (eb20e123-a4f6-4bf4-8a4f-0a8433b04f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:08 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-bc54a8b9-4f29-4f82-94c8-f6487b46fef6 tempest-VolumeQuotasAdminTestJSON-2076389259 None] Created volume successfully. Jul 08 18:23:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-23b8c663-9b9e-43ae-b329-a80c75207205 req-12e54746-4a59-4a1e-98be-e4e9a5aa13e5 tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:09 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 1073741824" returned: 0 in 0.868s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:09 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 Jul 08 18:23:09 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:10 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a0859671-2fd7-407d-a8b0-d8948f443555 tempest-VolumeQuotasAdminTestJSON-498283385 None] Transfer volume completed successfully. Jul 08 18:23:10 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65" returned: 0 in 0.813s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-23b8c663-9b9e-43ae-b329-a80c75207205 req-12e54746-4a59-4a1e-98be-e4e9a5aa13e5 tempest-TestStampPattern-640461682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.315s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe5e52a-68e8-4107-a231-74f858be181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a666267a-452d-4afd-9e31-84a6a7c4fc65', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0f17c3-b5c3-407c-a72a-43d4be4dd076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ae4fbe-77a1-4b71-a7da-1ad4b86498e7]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-23b8c663-9b9e-43ae-b329-a80c75207205 req-12e54746-4a59-4a1e-98be-e4e9a5aa13e5 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:10 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Volume volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 (a666267a-452d-4afd-9e31-84a6a7c4fc65): created successfully Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0f17c3-b5c3-407c-a72a-43d4be4dd076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Flow 'volume_create_manager' (0201b431-4bca-460d-892a-c9dd4819337b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:10 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3dc71060-8604-45ba-a877-aa1d354f008a tempest-GroupSnapshotsTest-846799256 None] Created volume successfully. Jul 08 18:23:10 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 Jul 08 18:23:10 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:11 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-23b8c663-9b9e-43ae-b329-a80c75207205 req-12e54746-4a59-4a1e-98be-e4e9a5aa13e5 tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13" returned: 0 in 1.042s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-23b8c663-9b9e-43ae-b329-a80c75207205 req-12e54746-4a59-4a1e-98be-e4e9a5aa13e5 tempest-TestStampPattern-640461682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.084s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-23b8c663-9b9e-43ae-b329-a80c75207205 req-12e54746-4a59-4a1e-98be-e4e9a5aa13e5 tempest-TestStampPattern-640461682 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-69996024-2cab-4a03-a507-281f2d4ede13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '997dfe45-80d8-4442-a94a-3d439cd1ebe1', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:23:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] GroupSnapshot d710cf07-5c34-4cd0-a9ad-b099113cf129: creating. Jul 08 18:23:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-23b8c663-9b9e-43ae-b329-a80c75207205 req-12e54746-4a59-4a1e-98be-e4e9a5aa13e5 tempest-TestStampPattern-640461682 None] attachment_update completed successfully. Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Group snapshot d710cf07-5c34-4cd0-a9ad-b099113cf129: creating. {{(pid=87309) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Creating offline snapshot 233e1b3f-2ca6-4b7a-b2c7-7588a83160fc of volume a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8182e431-0b6a-4196-bf0b-4a0d38d07f5f]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:12 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 Jul 08 18:23:12 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Acquiring lock "cinder-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Lock "cinder-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Acquiring lock "cinder-quobyte-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Lock "cinder-quobyte-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:12 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[53edd743-8ea6-4607-ba4f-391076929788]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:12 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe Jul 08 18:23:12 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:12 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65" returned: 0 in 0.908s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:12 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc 1G Jul 08 18:23:12 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:13 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe" returned: 0 in 0.910s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:13 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe Jul 08 18:23:13 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:13 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc 1G" returned: 0 in 0.977s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:13 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc Jul 08 18:23:13 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:13 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe" returned: 0 in 0.839s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Lock "cinder-quobyte-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe" released by "delete_volume" :: held 1.841s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:14 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Created reservations ['1cb27c1b-cf74-484a-bf63-67b1d934425b', '94ca60b3-6ec8-451e-9a5f-8df6f4b498c3', '4047ff12-9375-463a-84e1-19d4ff0780eb', '195f3f68-8cd0-4fe1-b9a2-68498bb64270'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:23:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:14 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:23:14 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:15 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" returned: 0 in 1.361s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:15 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:23:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:15 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc Jul 08 18:23:15 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:15 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.268s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:15 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:23:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Deleted volume successfully. Jul 08 18:23:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81226c4c-b017-4104-9e57-76de4e67eb1b tempest-VolumeQuotasAdminTestJSON-307877208 None] Lock "cinder-dc7d1275-6f62-40cb-8c48-76daf6c1a9fe-delete_volume" released by "delete_volume" :: held 3.574s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:16 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" returned: 0 in 1.254s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:16 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.info Jul 08 18:23:16 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:17 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.info" returned: 0 in 1.297s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:17 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:23:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:17 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.info Jul 08 18:23:17 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:18 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.info" returned: 0 in 0.803s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.731s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:18 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0eb124a0-406a-42cc-b755-ed1896843983 tempest-GroupSnapshotsTest-846799256 None] group_snapshot d710cf07-5c34-4cd0-a9ad-b099113cf129: created successfully Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-233e1b3f-2ca6-4b7a-b2c7-7588a83160fc-5a81b1f4-8306-46d3-af87-b5085a7f4688" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-233e1b3f-2ca6-4b7a-b2c7-7588a83160fc-5a81b1f4-8306-46d3-af87-b5085a7f4688" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Creating volume 5a81b1f4-8306-46d3-af87-b5085a7f4688 from snapshot 233e1b3f-2ca6-4b7a-b2c7-7588a83160fc {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-5a81b1f4-8306-46d3-af87-b5085a7f4688" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-5a81b1f4-8306-46d3-af87-b5085a7f4688" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] snapshot: 233e1b3f-2ca6-4b7a-b2c7-7588a83160fc, volume: 5a81b1f4-8306-46d3-af87-b5085a7f4688, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78589db-3370-480b-86f4-c734a5624490]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:21 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc Jul 08 18:23:21 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:21 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-3378f897-f5d2-4adf-a29c-f4a9dd9f0633 req-21ca3a5e-701f-41ca-9c04-ffc2b57991f4 tempest-TestStampPattern-640461682 None] Terminate volume connection completed successfully. Jul 08 18:23:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-3378f897-f5d2-4adf-a29c-f4a9dd9f0633 req-21ca3a5e-701f-41ca-9c04-ffc2b57991f4 tempest-TestStampPattern-640461682 None] Deleting attachment 997dfe45-80d8-4442-a94a-3d439cd1ebe1. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:23:22 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" returned: 0 in 1.258s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a666267a-452d-4afd-9e31-84a6a7c4fc65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:23:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:23:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:23:22 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c48695-ace2-478c-9257-ecaabc8efbf7]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:22 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 Jul 08 18:23:22 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:23 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65" returned: 0 in 1.201s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:23 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:23:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:23 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 Jul 08 18:23:23 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=99,cinder:SELECT=91,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=107,cinder:SELECT=99,cinder:DELETE=4,cinder:INSERT=24 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Flow 'volume_create_manager' (4fac0165-16de-4697-a48c-20ee041dd365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea1c01e-7f15-499a-af56-55ff31490888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea1c01e-7f15-499a-af56-55ff31490888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1996272643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b3c45b-4340-4d5b-b2c4-9f31177b5c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee115dc03ad84115b35abb97bed1813e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:29Z,use_quota=True,user_id='7476184945924e7ba722a8a76559910a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(476aed16-6a58-46c4-ba44-f003ce611b29),volume_type_id=476aed16-6a58-46c4-ba44-f003ce611b29)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2626af07-23db-4530-94b5-805b36caa6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2626af07-23db-4530-94b5-805b36caa6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599ccebc-2226-40ba-8d84-08bda3700ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599ccebc-2226-40ba-8d84-08bda3700ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b3c45b-4340-4d5b-b2c4-9f31177b5c11', 'volume_name': 'volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afea5d2c-b7d8-4df9-bb12-df2469bc119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afea5d2c-b7d8-4df9-bb12-df2469bc119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbf8958-7f25-42a0-8039-5462d506dae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:29 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Volume c6b3c45b-4340-4d5b-b2c4-9f31177b5c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11', 'volume_size': 1} Jul 08 18:23:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:31 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688" returned: 0 in 7.344s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9610896f-111c-497b-be18-ebed8ff44fca]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:31 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 Jul 08 18:23:31 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:31 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65" returned: 0 in 0.906s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:31 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:23:31 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Converted 1024.00 MB image at 139.40 MB/s Jul 08 18:23:31 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:23:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:32 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 Jul 08 18:23:32 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:32 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688" returned: 0 in 0.602s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-5a81b1f4-8306-46d3-af87-b5085a7f4688" released by "_copy_volume_from_snapshot" :: held 11.474s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-233e1b3f-2ca6-4b7a-b2c7-7588a83160fc-5a81b1f4-8306-46d3-af87-b5085a7f4688" released by "_create_volume_from_snapshot" :: held 11.523s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.551s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.199s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Creating offline snapshot 36f51181-988d-4adc-804f-0f7f34c88dc1 of volume 69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:23:32 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4a73dc-c2f1-47ae-bd68-57dc29598f35]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:32 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a06f15f1-cd08-4a1c-bcce-c049841b1955 tempest-GroupSnapshotsTest-846799256 None] Create group from source-snapshot-d710cf07-5c34-4cd0-a9ad-b099113cf129 completed successfully. Jul 08 18:23:32 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 Jul 08 18:23:32 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-5a81b1f4-8306-46d3-af87-b5085a7f4688" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-5a81b1f4-8306-46d3-af87-b5085a7f4688" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3190200a-9d3b-4d5f-849b-59f0abcb0b5d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:33 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 Jul 08 18:23:33 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:33 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13" returned: 0 in 0.744s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:33 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 1G Jul 08 18:23:33 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:33 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688" returned: 0 in 0.717s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:33 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688 Jul 08 18:23:33 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:34 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 1G" returned: 0 in 0.780s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69996024-2cab-4a03-a507-281f2d4ede13 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:34 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69996024-2cab-4a03-a507-281f2d4ede13 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 Jul 08 18:23:34 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:34 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5a81b1f4-8306-46d3-af87-b5085a7f4688" returned: 0 in 0.678s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-5a81b1f4-8306-46d3-af87-b5085a7f4688" released by "delete_volume" :: held 1.447s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Created reservations ['fa32f843-0750-40e0-beaf-c71f5f9e1755'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:23:34 devstack cinder-volume[87309]: WARNING cinder.quota [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1850613799 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1850613799, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:23:34 devstack cinder-volume[87309]: WARNING cinder.quota [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1850613799 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1850613799, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Created reservations ['fce8d012-44d9-4901-91ce-3dcca6bf8437', '2a2c0aaf-ed51-41df-bd01-74ef63ee8daf', 'c1905f4b-fcd0-4a0d-86f1-6ea7ad1d1495', 'bbc34735-e9af-4f19-baf5-95e900b605c8'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:34 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:23:34 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:34 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69996024-2cab-4a03-a507-281f2d4ede13 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1" returned: 0 in 0.693s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:34 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 is being set with open permissions: ugo+rw Jul 08 18:23:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:34 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 Jul 08 18:23:34 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:35 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.602s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:23:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1464efe8-c123-4596-9d59-b38bee7b1860 tempest-GroupSnapshotsTest-846799256 None] Delete group completed successfully. Jul 08 18:23:35 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1" returned: 0 in 0.661s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] group_snapshot d710cf07-5c34-4cd0-a9ad-b099113cf129: deleting Jul 08 18:23:35 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.info Jul 08 18:23:35 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] group_snapshot d710cf07-5c34-4cd0-a9ad-b099113cf129: deleting {{(pid=87309) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-a666267a-452d-4afd-9e31-84a6a7c4fc65" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-a666267a-452d-4afd-9e31-84a6a7c4fc65" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Deleting offline snapshot 233e1b3f-2ca6-4b7a-b2c7-7588a83160fc of volume a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] snapshot_file for this snap is: volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5668301f-b494-43f9-bc6c-94db466edc64]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:35 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc Jul 08 18:23:35 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:36 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.info" returned: 0 in 0.703s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:36 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.info is being set with open permissions: ugo+rw Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:36 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.info Jul 08 18:23:36 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:36 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" returned: 0 in 0.730s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a666267a-452d-4afd-9e31-84a6a7c4fc65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b83d975-8925-4f59-a317-c4869b5b2cb3]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:36 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 Jul 08 18:23:36 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:36 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.info" returned: 0 in 0.674s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.357s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.438s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1996272643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b3c45b-4340-4d5b-b2c4-9f31177b5c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee115dc03ad84115b35abb97bed1813e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:29Z,use_quota=True,user_id='7476184945924e7ba722a8a76559910a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(476aed16-6a58-46c4-ba44-f003ce611b29),volume_type_id=476aed16-6a58-46c4-ba44-f003ce611b29)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Creating volume c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:23:36 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:23:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:37 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 1073741824 Jul 08 18:23:37 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9ae5ad7d-5ba5-48fd-b528-d550e3a64f1f tempest-TestStampPattern-640461682 None] Create snapshot completed successfully Jul 08 18:23:37 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65" returned: 0 in 0.810s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:37 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc Jul 08 18:23:37 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:37 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 1073741824" returned: 0 in 0.944s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:37 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 Jul 08 18:23:37 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:38 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" returned: 0 in 0.862s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:38 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc Jul 08 18:23:38 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:38 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11" returned: 0 in 0.741s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbf8958-7f25-42a0-8039-5462d506dae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df48bdda-4d8a-474a-ac5f-4c2e0e04e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Volume volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 (c6b3c45b-4340-4d5b-b2c4-9f31177b5c11): created successfully Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df48bdda-4d8a-474a-ac5f-4c2e0e04e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Flow 'volume_create_manager' (4fac0165-16de-4697-a48c-20ee041dd365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a666d6ea-1a72-4d2e-94ed-629f12a43389 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Created volume successfully. Jul 08 18:23:38 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65.233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" returned: 0 in 0.736s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-233e1b3f-2ca6-4b7a-b2c7-7588a83160fc" released by "_delete_snapshot" :: held 3.247s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-a666267a-452d-4afd-9e31-84a6a7c4fc65" released by "delete_snapshot" :: held 3.271s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:38 devstack cinder-volume[87309]: WARNING cinder.quota [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1850613799 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1850613799, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:23:39 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] Created reservations ['27fa55b4-43af-4897-9534-ec04d133ca89', '56846ec1-dd9b-4d09-ab4e-b2ae4edc6f0a', '6b20fb71-5075-42d5-af49-9572436ba5b4', 'a44fe5c3-48e8-4e12-80cf-4baad4c1c661'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:23:39 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c3068634-fc1f-4c5f-be55-b0c739691360 tempest-GroupSnapshotsTest-846799256 None] group_snapshot d710cf07-5c34-4cd0-a9ad-b099113cf129: deleted successfully Jul 08 18:23:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:39 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:23:39 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:40 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.690s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:23:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f5c2ea43-42d9-4a9d-b1ea-c3c347a26c59 tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Retype volume completed successfully. Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-a666267a-452d-4afd-9e31-84a6a7c4fc65" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-a666267a-452d-4afd-9e31-84a6a7c4fc65" acquired by "delete_volume" :: waited 0.034s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fbe0e9-6138-46b5-966f-b79581832bcf]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:40 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 Jul 08 18:23:40 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Acquiring lock "cinder-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "cinder-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Acquiring lock "cinder-quobyte-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "cinder-quobyte-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfc8995-7acd-4b69-a9f9-073f9848aa84]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:40 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 Jul 08 18:23:40 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:41 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65" returned: 0 in 0.877s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:41 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65 Jul 08 18:23:41 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:41 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11" returned: 0 in 0.801s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:41 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11 Jul 08 18:23:41 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:41 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a666267a-452d-4afd-9e31-84a6a7c4fc65" returned: 0 in 0.669s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-a666267a-452d-4afd-9e31-84a6a7c4fc65" released by "delete_volume" :: held 1.625s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:41 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Created reservations ['dca87d60-0f70-4a6a-b989-d14dce6f5922'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:23:42 devstack cinder-volume[87309]: WARNING cinder.db.api [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1850613799'] Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Created reservations ['5c0a615e-26e1-498b-8449-b980064f0e70', 'a02e85ab-30f1-4b4b-a500-8e2e804aacf0', '3c1643e2-47d7-415c-a4a0-a6c7ce6c563b', 'a9833c93-117b-4c6c-95e9-e1315523ea2d'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:42 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:23:42 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:42 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11" returned: 0 in 0.755s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "cinder-quobyte-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11" released by "delete_volume" :: held 1.607s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:42 devstack cinder-volume[87309]: WARNING cinder.quota [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:23:42 devstack cinder-volume[87309]: WARNING cinder.quota [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Created reservations ['eeedccf2-8e4d-42f2-b06e-316ea24d4f07', 'ecb785cc-8aea-41eb-ab6c-808f37be0f73', 'bb1fe85a-564b-4afe-89b4-b59473e7a8b2', 'beb8bcc5-d755-4946-9eec-f7e7bfd37c7c'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:42 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:23:42 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:42 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.778s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:42 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:23:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4f1e7d53-991f-4d1a-8c5b-6db893b43d4e tempest-GroupSnapshotsTest-846799256 None] Delete group completed successfully. Jul 08 18:23:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4cae7a70-66a9-42cd-84b1-2fffb87506e7 tempest-GroupSnapshotsTest-846799256 None] Group tempest-GroupSnapshotsTest-Group-1371621016: creating Jul 08 18:23:43 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.777s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:43 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:23:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Deleted volume successfully. Jul 08 18:23:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-20ea58e0-96fa-4e72-b7f5-ef1f2e39510d tempest-VolumeRetypeWithoutMigrationTest-920004750 None] Lock "cinder-c6b3c45b-4340-4d5b-b2c4-9f31177b5c11-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:23:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4cae7a70-66a9-42cd-84b1-2fffb87506e7 tempest-GroupSnapshotsTest-846799256 None] Group tempest-GroupSnapshotsTest-Group-1371621016: created successfully Jul 08 18:23:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4cae7a70-66a9-42cd-84b1-2fffb87506e7 tempest-GroupSnapshotsTest-846799256 None] Create group completed successfully. Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Flow 'volume_create_manager' (ae1cfa2a-975d-4e93-946b-486ce19ed4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52493c31-5ca5-4744-bc13-b8fe91b7741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52493c31-5ca5-4744-bc13-b8fe91b7741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-614844458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5b349b1-3c6b-4f31-98fa-bc78642f1906,host='devstack@QuobyteHD#QuobyteHD',id=258d1376-aa04-4caf-8a45-cb7775c483f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648278fe867c4d19a1b99de7145a1104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:45Z,use_quota=True,user_id='b34ff75932924328b4c84f307de80fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2e29203-cc9d-4421-98ed-d2e9787bf5b3),volume_type_id=e2e29203-cc9d-4421-98ed-d2e9787bf5b3)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef22189-4574-4f59-9e04-51f6392b7234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef22189-4574-4f59-9e04-51f6392b7234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1dd225c-4835-44ad-ba96-bd3de2709afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1dd225c-4835-44ad-ba96-bd3de2709afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258d1376-aa04-4caf-8a45-cb7775c483f0', 'volume_name': 'volume-258d1376-aa04-4caf-8a45-cb7775c483f0', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fed8ed5-92e6-43c3-918f-ff6e27e3facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fed8ed5-92e6-43c3-918f-ff6e27e3facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f2783b-3814-4ee4-a580-93933cddffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:45 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Volume 258d1376-aa04-4caf-8a45-cb7775c483f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258d1376-aa04-4caf-8a45-cb7775c483f0', 'volume_size': 1} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5b349b1-3c6b-4f31-98fa-bc78642f1906,created_at=2026-07-08T16:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-614844458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5b349b1-3c6b-4f31-98fa-bc78642f1906,host='devstack@QuobyteHD#QuobyteHD',id=258d1376-aa04-4caf-8a45-cb7775c483f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648278fe867c4d19a1b99de7145a1104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:45Z,use_quota=True,user_id='b34ff75932924328b4c84f307de80fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2e29203-cc9d-4421-98ed-d2e9787bf5b3),volume_type_id=e2e29203-cc9d-4421-98ed-d2e9787bf5b3)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Creating volume 258d1376-aa04-4caf-8a45-cb7775c483f0 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:23:45 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:23:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:45 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 1073741824 Jul 08 18:23:45 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:46 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 1073741824" returned: 0 in 1.110s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:46 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 Jul 08 18:23:46 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:47 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0" returned: 0 in 0.738s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:23:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f2783b-3814-4ee4-a580-93933cddffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258d1376-aa04-4caf-8a45-cb7775c483f0', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69694fc-0155-4c30-a4f8-ce00697ab373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:47 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Volume volume-258d1376-aa04-4caf-8a45-cb7775c483f0 (258d1376-aa04-4caf-8a45-cb7775c483f0): created successfully Jul 08 18:23:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69694fc-0155-4c30-a4f8-ce00697ab373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Flow 'volume_create_manager' (ae1cfa2a-975d-4e93-946b-486ce19ed4f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-327a6564-aad6-4690-ab07-7a52240dc7a8 tempest-GroupSnapshotsTest-846799256 None] Created volume successfully. Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Flow 'volume_create_manager' (24e8d682-58fc-43c4-83c0-7e5b0e94f4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544b862e-c9b9-4884-adba-4c074c43091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544b862e-c9b9-4884-adba-4c074c43091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1058097991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5b349b1-3c6b-4f31-98fa-bc78642f1906,host='devstack@QuobyteHD#QuobyteHD',id=b66e6b9d-7da0-43a1-8845-6a2afce9ae07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648278fe867c4d19a1b99de7145a1104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:48Z,use_quota=True,user_id='b34ff75932924328b4c84f307de80fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2e29203-cc9d-4421-98ed-d2e9787bf5b3),volume_type_id=e2e29203-cc9d-4421-98ed-d2e9787bf5b3)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8a5e31-9b8d-4ef9-9a0d-ba38bce991a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8a5e31-9b8d-4ef9-9a0d-ba38bce991a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a07bce1-02de-4ee4-8255-b9e6bd0f5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a07bce1-02de-4ee4-8255-b9e6bd0f5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b66e6b9d-7da0-43a1-8845-6a2afce9ae07', 'volume_name': 'volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169182c3-890e-4fc4-864f-242f238f6e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169182c3-890e-4fc4-864f-242f238f6e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50acdfd2-6eae-4884-9cdb-43089cb82137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Volume b66e6b9d-7da0-43a1-8845-6a2afce9ae07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07', 'volume_size': 1} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5b349b1-3c6b-4f31-98fa-bc78642f1906,created_at=2026-07-08T16:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1058097991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5b349b1-3c6b-4f31-98fa-bc78642f1906,host='devstack@QuobyteHD#QuobyteHD',id=b66e6b9d-7da0-43a1-8845-6a2afce9ae07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648278fe867c4d19a1b99de7145a1104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:48Z,use_quota=True,user_id='b34ff75932924328b4c84f307de80fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2e29203-cc9d-4421-98ed-d2e9787bf5b3),volume_type_id=e2e29203-cc9d-4421-98ed-d2e9787bf5b3)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Creating volume b66e6b9d-7da0-43a1-8845-6a2afce9ae07 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:23:48 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:48 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 1073741824 Jul 08 18:23:48 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-3cdbd64f-d48e-4123-8190-6d80ae32fe5c req-e355872d-b2ed-4b68-83a7-e4c0e9126e03 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Flow 'volume_create_manager' (5320ab03-76a6-4105-b62c-bce1e57e9b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11343d3e-b5ff-4bf9-8edf-e11a4f687eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11343d3e-b5ff-4bf9-8edf-e11a4f687eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1414282386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857bd52e-2a97-4b6e-98f5-4305cc5742c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501aad8c94964a5db8be2cfe898b1e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36f51181-988d-4adc-804f-0f7f34c88dc1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:49Z,use_quota=True,user_id='f71c921cad6648f7a75cca112ac0c96a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3faab4-8e15-455c-8e2a-bd2b661bd63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3faab4-8e15-455c-8e2a-bd2b661bd63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a25bf5-24b2-4378-b2d8-4d8ae05ae3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a25bf5-24b2-4378-b2d8-4d8ae05ae3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '857bd52e-2a97-4b6e-98f5-4305cc5742c9', 'volume_name': 'volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9', 'volume_size': 1, 'snapshot_id': '36f51181-988d-4adc-804f-0f7f34c88dc1'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4418464a-2a1c-487e-8765-7cb4ff91a3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4418464a-2a1c-487e-8765-7cb4ff91a3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d1189c-8347-4e0c-a846-a5fb65cb4ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:48 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Volume 857bd52e-2a97-4b6e-98f5-4305cc5742c9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9', 'volume_size': 1, 'snapshot_id': '36f51181-988d-4adc-804f-0f7f34c88dc1'} Jul 08 18:23:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:49 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 1073741824" returned: 0 in 1.318s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:49 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 Jul 08 18:23:49 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:49 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Flow 'volume_create_manager' (8dbca787-b6b9-4776-82df-11652aed2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f122294-8a58-465b-91d8-24d557c92d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f122294-8a58-465b-91d8-24d557c92d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1242884095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b900ab1-5b34-44f2-b5f3-780e19341b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c78e54dfb146488fb8007632fee1fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:50Z,use_quota=True,user_id='0a7bcc6df4ca44c9b80747fc42d9bb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10227c31-0dbe-4321-bdfb-c569478d2434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10227c31-0dbe-4321-bdfb-c569478d2434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48bd9064-4259-4ada-ae78-d36e7bbfe411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48bd9064-4259-4ada-ae78-d36e7bbfe411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b900ab1-5b34-44f2-b5f3-780e19341b75', 'volume_name': 'volume-9b900ab1-5b34-44f2-b5f3-780e19341b75', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c60952-c48d-411c-86d0-2ce88a596a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c60952-c48d-411c-86d0-2ce88a596a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c09bfc-0b44-4b3e-add3-7a211737e966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Volume 9b900ab1-5b34-44f2-b5f3-780e19341b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b900ab1-5b34-44f2-b5f3-780e19341b75', 'volume_size': 1} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:50 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" returned: 0 in 0.764s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-3cdbd64f-d48e-4123-8190-6d80ae32fe5c req-e355872d-b2ed-4b68-83a7-e4c0e9126e03 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.870s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50acdfd2-6eae-4884-9cdb-43089cb82137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82972fe-010c-4334-a5be-2dd445275cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc74facd-9359-4b2c-9c3a-27af30bb4126]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3cdbd64f-d48e-4123-8190-6d80ae32fe5c req-e355872d-b2ed-4b68-83a7-e4c0e9126e03 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Volume volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 (b66e6b9d-7da0-43a1-8845-6a2afce9ae07): created successfully Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82972fe-010c-4334-a5be-2dd445275cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:23:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Flow 'volume_create_manager' (24e8d682-58fc-43c4-83c0-7e5b0e94f4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:23:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-bfecfca0-fca2-4c26-b485-baeedd43a82e tempest-GroupSnapshotsTest-846799256 None] Created volume successfully. Jul 08 18:23:50 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf Jul 08 18:23:50 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0aaf52ca-1ca7-45f6-ab1c-70be41d755ea tempest-GroupSnapshotsTest-846799256 None] Update group completed successfully. Jul 08 18:23:51 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-3cdbd64f-d48e-4123-8190-6d80ae32fe5c req-e355872d-b2ed-4b68-83a7-e4c0e9126e03 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf" returned: 0 in 0.959s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-3cdbd64f-d48e-4123-8190-6d80ae32fe5c req-e355872d-b2ed-4b68-83a7-e4c0e9126e03 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.735s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-quobyte-36f51181-988d-4adc-804f-0f7f34c88dc1-857bd52e-2a97-4b6e-98f5-4305cc5742c9" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-36f51181-988d-4adc-804f-0f7f34c88dc1-857bd52e-2a97-4b6e-98f5-4305cc5742c9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Creating volume 857bd52e-2a97-4b6e-98f5-4305cc5742c9 from snapshot 36f51181-988d-4adc-804f-0f7f34c88dc1 {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-quobyte-857bd52e-2a97-4b6e-98f5-4305cc5742c9" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-857bd52e-2a97-4b6e-98f5-4305cc5742c9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] snapshot: 36f51181-988d-4adc-804f-0f7f34c88dc1, volume: 857bd52e-2a97-4b6e-98f5-4305cc5742c9, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-3cdbd64f-d48e-4123-8190-6d80ae32fe5c req-e355872d-b2ed-4b68-83a7-e4c0e9126e03 tempest-TestInstancesWithCinderVolumes-1599322074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-1b999838-ce43-4bad-b41a-686f03c88cdf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a38d3d3-0448-430c-8cf2-d170a36530cc', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[26393aaf-968a-4d8a-b1ce-26de1e73882b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-3cdbd64f-d48e-4123-8190-6d80ae32fe5c req-e355872d-b2ed-4b68-83a7-e4c0e9126e03 tempest-TestInstancesWithCinderVolumes-1599322074 None] attachment_update completed successfully. Jul 08 18:23:51 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 Jul 08 18:23:51 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-38cf4bc9-9978-4c5d-8b31-148f86fda774 tempest-GroupSnapshotsTest-846799256 None] Update group completed successfully. Jul 08 18:23:52 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1" returned: 0 in 0.818s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69996024-2cab-4a03-a507-281f2d4ede13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:23:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:23:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:23:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a7bff5-4cd5-4c2a-9e11-3cf036c4a3da]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:52 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 Jul 08 18:23:52 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:53 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 08 18:23:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13" returned: 0 in 0.793s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:53 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:23:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:23:53 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 Jul 08 18:23:53 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:23:53 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8a3386f9-99a8-4b4d-855a-f3618f7a5ddf tempest-GroupSnapshotsTest-846799256 None] Update group completed successfully. Jul 08 18:23:55 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-46e1a42e-9b26-462c-bfbc-6901ceb5c94e tempest-GroupSnapshotsTest-846799256 None] Update group completed successfully. Jul 08 18:23:58 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] GroupSnapshot dde9667a-3ae4-47f3-8c29-9bc1ef00dc50: creating. Jul 08 18:23:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Group snapshot dde9667a-3ae4-47f3-8c29-9bc1ef00dc50: creating. {{(pid=87309) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:23:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:23:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9" returned: 0 in 6.471s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:23:59 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[59379022-a5c7-487c-9fdf-38755221c6f5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:23:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:00 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 Jul 08 18:24:00 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-13a6d5f0-85f7-4357-aa33-07c15b3ddfd3 req-7811b74d-c979-4f3d-825b-483cd8fe1c8c tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:01 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13" returned: 0 in 1.143s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:24:01 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Converted 1024.00 MB image at 158.23 MB/s Jul 08 18:24:01 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 is being set with open permissions: ugo+rw Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:01 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 Jul 08 18:24:01 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:01 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9" returned: 0 in 0.683s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-857bd52e-2a97-4b6e-98f5-4305cc5742c9" released by "_copy_volume_from_snapshot" :: held 10.029s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-36f51181-988d-4adc-804f-0f7f34c88dc1-857bd52e-2a97-4b6e-98f5-4305cc5742c9" released by "_create_volume_from_snapshot" :: held 10.061s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.079s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.704s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1242884095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b900ab1-5b34-44f2-b5f3-780e19341b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c78e54dfb146488fb8007632fee1fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:23:50Z,use_quota=True,user_id='0a7bcc6df4ca44c9b80747fc42d9bb77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Creating volume 9b900ab1-5b34-44f2-b5f3-780e19341b75 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:24:01 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:01 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 1073741824 Jul 08 18:24:01 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d1189c-8347-4e0c-a846-a5fb65cb4ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9', 'volume_size': 1, 'snapshot_id': '36f51181-988d-4adc-804f-0f7f34c88dc1'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694c82f0-a0a5-462d-9d62-b2cd033a0845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:01 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Volume volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 (857bd52e-2a97-4b6e-98f5-4305cc5742c9): created successfully Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694c82f0-a0a5-462d-9d62-b2cd033a0845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Flow 'volume_create_manager' (5320ab03-76a6-4105-b62c-bce1e57e9b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8982e2ea-88b0-435d-a0fa-dcff314803c8 tempest-TestStampPattern-640461682 None] Created volume successfully. Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:02 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:02 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:02 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 1073741824" returned: 0 in 0.971s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:02 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 Jul 08 18:24:02 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:03 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.710s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:24:03 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75" returned: 0 in 0.622s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.204s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c09bfc-0b44-4b3e-add3-7a211737e966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b900ab1-5b34-44f2-b5f3-780e19341b75', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cc398c-ad86-4ee3-ab5c-2bf18665cfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Creating offline snapshot 72293733-e68a-4ee5-a8a0-b2f6537808be of volume b66e6b9d-7da0-43a1-8845-6a2afce9ae07 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:24:03 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Volume volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 (9b900ab1-5b34-44f2-b5f3-780e19341b75): created successfully Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cc398c-ad86-4ee3-ab5c-2bf18665cfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Flow 'volume_create_manager' (8dbca787-b6b9-4776-82df-11652aed2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c03ba4-a63e-45eb-acf5-72c8de021654]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:03 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4c7959d0-ed2c-42de-8c88-ef26d240d789 tempest-VolumesServicesTestJSON-1941505625 None] Created volume successfully. Jul 08 18:24:03 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 Jul 08 18:24:03 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Acquiring lock "cinder-9b900ab1-5b34-44f2-b5f3-780e19341b75-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Lock "cinder-9b900ab1-5b34-44f2-b5f3-780e19341b75-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Acquiring lock "cinder-quobyte-9b900ab1-5b34-44f2-b5f3-780e19341b75" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Lock "cinder-quobyte-9b900ab1-5b34-44f2-b5f3-780e19341b75" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:04 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da2a65c-cdb0-4c20-98a7-e8412b0ce7a4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:04 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 Jul 08 18:24:04 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:04 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" returned: 0 in 0.975s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:04 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be 1G Jul 08 18:24:04 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:05 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75" returned: 0 in 0.900s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:05 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75 Jul 08 18:24:05 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:05 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be 1G" returned: 0 in 0.885s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:05 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be Jul 08 18:24:05 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:05 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9b900ab1-5b34-44f2-b5f3-780e19341b75" returned: 0 in 0.694s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Lock "cinder-quobyte-9b900ab1-5b34-44f2-b5f3-780e19341b75" released by "delete_volume" :: held 1.664s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Created reservations ['f4a5bd32-1b04-4aad-8f64-0e6f93f42d16', 'e8b32da7-c64d-4656-8cdf-8d5b6f5dac22', 'cdfe2781-2b7f-4e54-8ab8-359f29db732d', '2eb7d4ad-7499-400c-b34a-3d9f21522a63'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:05 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:05 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:06 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be" returned: 0 in 0.919s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:06 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:24:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:06 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be Jul 08 18:24:06 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:06 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.029s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:06 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Deleted volume successfully. Jul 08 18:24:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-40ea6fcf-149a-4d17-9b3b-51263672db73 tempest-VolumesServicesTestJSON-1941505625 None] Lock "cinder-9b900ab1-5b34-44f2-b5f3-780e19341b75-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:07 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be" returned: 0 in 0.827s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:07 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.info Jul 08 18:24:07 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:07 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.info" returned: 0 in 0.809s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:07 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:24:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:07 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.info Jul 08 18:24:08 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:08 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.info" returned: 0 in 0.992s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.537s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Creating offline snapshot 7ec0805e-05d9-46c7-a98d-f00b47fe514b of volume 258d1376-aa04-4caf-8a45-cb7775c483f0 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:24:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b598a5f0-f513-431d-a896-47cc0f471f2e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:09 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 Jul 08 18:24:09 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:10 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0" returned: 0 in 1.024s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:10 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b 1G Jul 08 18:24:10 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:11 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b 1G" returned: 0 in 1.165s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d1376-aa04-4caf-8a45-cb7775c483f0 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:11 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d1376-aa04-4caf-8a45-cb7775c483f0 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b Jul 08 18:24:11 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:12 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d1376-aa04-4caf-8a45-cb7775c483f0 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b" returned: 0 in 0.819s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:12 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:24:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:12 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b Jul 08 18:24:12 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:12 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b" returned: 0 in 0.704s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:12 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.info Jul 08 18:24:12 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:13 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.info" returned: 0 in 0.731s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:13 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:24:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:13 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.info Jul 08 18:24:13 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:14 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.info" returned: 0 in 0.785s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.349s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-13a6d5f0-85f7-4357-aa33-07c15b3ddfd3 req-7811b74d-c979-4f3d-825b-483cd8fe1c8c tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.362s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:14 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a41f6b-2106-416f-91da-65e19cf17cd6]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-13a6d5f0-85f7-4357-aa33-07c15b3ddfd3 req-7811b74d-c979-4f3d-825b-483cd8fe1c8c tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a0a4eafc-a18b-4c6c-9e44-618dfcbb872c tempest-GroupSnapshotsTest-846799256 None] group_snapshot dde9667a-3ae4-47f3-8c29-9bc1ef00dc50: created successfully Jul 08 18:24:14 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d Jul 08 18:24:14 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:15 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-13a6d5f0-85f7-4357-aa33-07c15b3ddfd3 req-7811b74d-c979-4f3d-825b-483cd8fe1c8c tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d" returned: 0 in 0.923s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-13a6d5f0-85f7-4357-aa33-07c15b3ddfd3 req-7811b74d-c979-4f3d-825b-483cd8fe1c8c tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-13a6d5f0-85f7-4357-aa33-07c15b3ddfd3 req-7811b74d-c979-4f3d-825b-483cd8fe1c8c tempest-TestInstancesWithCinderVolumes-1599322074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7dfc50a-f4da-4349-a49d-9e6763e24de3', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:24:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-13a6d5f0-85f7-4357-aa33-07c15b3ddfd3 req-7811b74d-c979-4f3d-825b-483cd8fe1c8c tempest-TestInstancesWithCinderVolumes-1599322074 None] attachment_update completed successfully. Jul 08 18:24:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] group_snapshot dde9667a-3ae4-47f3-8c29-9bc1ef00dc50: deleting Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] group_snapshot dde9667a-3ae4-47f3-8c29-9bc1ef00dc50: deleting {{(pid=87309) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-72293733-e68a-4ee5-a8a0-b2f6537808be" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-72293733-e68a-4ee5-a8a0-b2f6537808be" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Deleting offline snapshot 72293733-e68a-4ee5-a8a0-b2f6537808be of volume b66e6b9d-7da0-43a1-8845-6a2afce9ae07 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] snapshot_file for this snap is: volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12a0022-6f78-44f6-b2cc-8fb4c5c64da2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:15 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be Jul 08 18:24:15 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:16 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be" returned: 0 in 1.017s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:24:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c234ed3-d76b-41c8-9ed3-6952b6250247]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:16 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 Jul 08 18:24:16 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:17 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" returned: 0 in 0.841s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:17 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be Jul 08 18:24:17 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:18 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be" returned: 0 in 0.982s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:18 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be Jul 08 18:24:18 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:19 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07.72293733-e68a-4ee5-a8a0-b2f6537808be" returned: 0 in 0.777s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-72293733-e68a-4ee5-a8a0-b2f6537808be" released by "_delete_snapshot" :: held 3.758s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" released by "delete_snapshot" :: held 3.799s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-258d1376-aa04-4caf-8a45-cb7775c483f0" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-258d1376-aa04-4caf-8a45-cb7775c483f0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-7ec0805e-05d9-46c7-a98d-f00b47fe514b" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-7ec0805e-05d9-46c7-a98d-f00b47fe514b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Deleting offline snapshot 7ec0805e-05d9-46c7-a98d-f00b47fe514b of volume 258d1376-aa04-4caf-8a45-cb7775c483f0 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] snapshot_file for this snap is: volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c048fd-d39d-4e1a-8088-1db937d4ad33]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:19 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b Jul 08 18:24:19 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:20 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b" returned: 0 in 0.865s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258d1376-aa04-4caf-8a45-cb7775c483f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:24:20 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b6fcb-d014-4922-bf7f-1abf0e9d88f9]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:20 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 Jul 08 18:24:20 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:21 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0" returned: 0 in 0.863s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:21 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b Jul 08 18:24:21 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:22 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b" returned: 0 in 0.801s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:22 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b Jul 08 18:24:22 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:22 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0.7ec0805e-05d9-46c7-a98d-f00b47fe514b" returned: 0 in 0.685s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-7ec0805e-05d9-46c7-a98d-f00b47fe514b" released by "_delete_snapshot" :: held 3.351s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-258d1376-aa04-4caf-8a45-cb7775c483f0" released by "delete_snapshot" :: held 3.383s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:22 devstack cinder-volume[87309]: WARNING cinder.quota [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-18889141 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-18889141, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:22 devstack cinder-volume[87309]: WARNING cinder.quota [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-18889141 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-18889141, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:22 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Created reservations ['07c31ab0-4953-4c1d-a8bf-4e7a2834bc10', '6bd97835-e621-4122-8c9a-5686b3ab7a83', '74f351fe-5d95-476c-b3cc-560f5e98c177', 'ecd1b7c5-e707-4131-a779-8f35e4f68749'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:23 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] Created reservations ['364f6669-8db9-4aab-b56f-b80971c792cc', '7ef85116-93fe-4bb0-bc12-c2e56ad01c3b', '82b96655-1e20-47e6-aa49-9b09ccc91c2d', 'c17c2b4d-c3f6-4e9d-837b-8d512e410399'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-36ccab06-27fb-4957-a398-edecdf6da54a tempest-GroupSnapshotsTest-846799256 None] group_snapshot dde9667a-3ae4-47f3-8c29-9bc1ef00dc50: deleted successfully Jul 08 18:24:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-258d1376-aa04-4caf-8a45-cb7775c483f0" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-258d1376-aa04-4caf-8a45-cb7775c483f0" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:23 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaec554-1a07-4afe-a9ae-799c85e6be43]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:23 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 Jul 08 18:24:23 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:24 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0" returned: 0 in 0.819s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:24 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0 Jul 08 18:24:24 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:24 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-3f2505ca-5b18-4eeb-8f24-cb884966c48c req-f8abe109-c29f-45be-85c6-d1072f91e44e tempest-TestInstancesWithCinderVolumes-1599322074 None] Terminate volume connection completed successfully. Jul 08 18:24:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-3f2505ca-5b18-4eeb-8f24-cb884966c48c req-f8abe109-c29f-45be-85c6-d1072f91e44e tempest-TestInstancesWithCinderVolumes-1599322074 None] Deleting attachment 1a38d3d3-0448-430c-8cf2-d170a36530cc. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:24:25 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-258d1376-aa04-4caf-8a45-cb7775c483f0" returned: 0 in 0.696s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-258d1376-aa04-4caf-8a45-cb7775c483f0" released by "delete_volume" :: held 1.587s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:25 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c07b0c-c0e6-44a5-944e-b979914f4ade]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:25 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 Jul 08 18:24:25 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:26 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" returned: 0 in 0.877s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:24:26 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07 Jul 08 18:24:26 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Flow 'volume_create_manager' (d4510732-00f2-41bc-baf0-88622f6b6b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1459b2f-5c78-448e-b10b-6f2f28bc9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1459b2f-5c78-448e-b10b-6f2f28bc9842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1137944086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0773c34-2eac-4fc9-a683-1e02a51f0087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f022fefa8ba14c64bc61b990c99d39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:24:26Z,use_quota=True,user_id='323a226a4ef74805add594c4a0ef5ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447d0c4d-f21e-47e0-bff1-a2a603b61d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447d0c4d-f21e-47e0-bff1-a2a603b61d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12889fb3-7be4-4dfa-897c-92d9bf86519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12889fb3-7be4-4dfa-897c-92d9bf86519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0773c34-2eac-4fc9-a683-1e02a51f0087', 'volume_name': 'volume-b0773c34-2eac-4fc9-a683-1e02a51f0087', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8265b0bb-9329-4eec-b022-1c56c9fc7432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8265b0bb-9329-4eec-b022-1c56c9fc7432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d8e1c7-3b2e-4d7c-b5bb-9fdb13bef07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:26 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Volume b0773c34-2eac-4fc9-a683-1e02a51f0087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0773c34-2eac-4fc9-a683-1e02a51f0087', 'volume_size': 1} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1137944086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0773c34-2eac-4fc9-a683-1e02a51f0087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f022fefa8ba14c64bc61b990c99d39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:24:26Z,use_quota=True,user_id='323a226a4ef74805add594c4a0ef5ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Creating volume b0773c34-2eac-4fc9-a683-1e02a51f0087 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:24:26 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:26 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 1073741824 Jul 08 18:24:26 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "cinder-1b999838-ce43-4bad-b41a-686f03c88cdf-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-1b999838-ce43-4bad-b41a-686f03c88cdf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "cinder-quobyte-1b999838-ce43-4bad-b41a-686f03c88cdf" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-quobyte-1b999838-ce43-4bad-b41a-686f03c88cdf" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[16660545-bbee-4cec-8001-661dcee04f2d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:26 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf Jul 08 18:24:26 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:26 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" returned: 0 in 0.653s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-b66e6b9d-7da0-43a1-8845-6a2afce9ae07" released by "delete_volume" :: held 1.598s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Created reservations ['d7eee8af-d745-4d93-824c-178f4f357470'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:26 devstack cinder-volume[87309]: WARNING cinder.quota [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-18889141 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-18889141, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:26 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Created reservations ['8d586464-8919-442b-afc3-35f1793aa7d3', 'b9db06ad-9b4f-4438-a855-a8f47de6f58a', '577acb18-7856-45f5-9937-fbba75a49eff', '000ee29d-f3a6-4771-ba22-3e683b3a1fa5'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Created reservations ['3116ffbe-55c4-4752-9e9a-adfbc0a6c83a', '30207d4a-bae3-4cc4-af1c-f30dd283ce31', 'fdc6ce0f-6a64-476e-ac0d-add12787bda8', '27570477-2159-4669-9d85-7f9a192af3bb'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:27 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 1073741824" returned: 0 in 1.079s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:27 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:27 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:27 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 Jul 08 18:24:27 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:27 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf" returned: 0 in 1.005s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:27 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf Jul 08 18:24:27 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:28 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.738s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6036d0d8-8fb1-4c10-afda-21b950b854ae tempest-GroupSnapshotsTest-846799256 None] Delete group completed successfully. Jul 08 18:24:28 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087" returned: 0 in 0.733s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d8e1c7-3b2e-4d7c-b5bb-9fdb13bef07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0773c34-2eac-4fc9-a683-1e02a51f0087', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ccbade-4321-49ac-b6da-0b5d526a008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:28 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Volume volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 (b0773c34-2eac-4fc9-a683-1e02a51f0087): created successfully Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ccbade-4321-49ac-b6da-0b5d526a008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Flow 'volume_create_manager' (d4510732-00f2-41bc-baf0-88622f6b6b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3f65158d-d8cc-4337-b80b-af5d88ffdae9 tempest-SnapshotMetadataTestJSON-285566209 None] Created volume successfully. Jul 08 18:24:28 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1b999838-ce43-4bad-b41a-686f03c88cdf" returned: 0 in 0.724s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-quobyte-1b999838-ce43-4bad-b41a-686f03c88cdf" released by "delete_volume" :: held 1.771s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:28 devstack cinder-volume[87309]: WARNING cinder.quota [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748590821-3870362 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748590821-3870362, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:28 devstack cinder-volume[87309]: WARNING cinder.quota [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748590821-3870362 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748590821-3870362, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Created reservations ['e4b98c68-9dac-4861-a559-135fda1f1ef3', '55a5cb3c-6004-4500-bd0a-1b60fdee47ea', '275f7349-3516-4b46-8572-858d9c145cc5', 'e098c50f-3c05-490d-8b44-48a4cf1a0ac9'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:28 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:28 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5b6a1e7d-d537-48a9-adaf-74955c2a2269 tempest-GroupSnapshotsTest-846799256 None] Group tempest-GroupSnapshotsTest-Group-1868373354: creating Jul 08 18:24:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5b6a1e7d-d537-48a9-adaf-74955c2a2269 tempest-GroupSnapshotsTest-846799256 None] Group tempest-GroupSnapshotsTest-Group-1868373354: created successfully Jul 08 18:24:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5b6a1e7d-d537-48a9-adaf-74955c2a2269 tempest-GroupSnapshotsTest-846799256 None] Create group completed successfully. Jul 08 18:24:29 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.673s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:29 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:29 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deleted volume successfully. Jul 08 18:24:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9d408945-5082-4dc1-9d10-4b004fde5c79 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-1b999838-ce43-4bad-b41a-686f03c88cdf-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Creating offline snapshot a23c0434-e660-425d-8b27-c9e32ca764a7 of volume b0773c34-2eac-4fc9-a683-1e02a51f0087 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:24:29 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353c00e-af10-4145-ba5a-a1f7fe94e51c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:29 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 Jul 08 18:24:29 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:30 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087" returned: 0 in 0.792s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:30 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 1G Jul 08 18:24:30 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=125,cinder:SELECT=127,cinder:INSERT=28,cinder:DELETE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=113,cinder:UPDATE=113,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Flow 'volume_create_manager' (19644446-692a-406f-9cb0-bed49bd7f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1f9fba-5b34-4be3-8a6a-ccc153d8a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1f9fba-5b34-4be3-8a6a-ccc153d8a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003331226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e91aa72b-0784-468d-a1fa-6e54daccb470,host='devstack@QuobyteHD#QuobyteHD',id=4f611b2b-8228-472e-a74b-89ec0e006c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648278fe867c4d19a1b99de7145a1104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:24:30Z,use_quota=True,user_id='b34ff75932924328b4c84f307de80fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70fec01f-048a-4153-b04c-9e09bdd3f8a6),volume_type_id=70fec01f-048a-4153-b04c-9e09bdd3f8a6)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c3b138-b6e9-430f-81ec-9cc56480fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c3b138-b6e9-430f-81ec-9cc56480fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19a16c3-db44-4b74-902b-9e33b724dc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19a16c3-db44-4b74-902b-9e33b724dc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f611b2b-8228-472e-a74b-89ec0e006c36', 'volume_name': 'volume-4f611b2b-8228-472e-a74b-89ec0e006c36', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f706eb86-280d-4784-91f3-2599f134f7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f706eb86-280d-4784-91f3-2599f134f7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541bb54a-d9ed-4ccf-8765-e4fe88b85cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:30 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Volume 4f611b2b-8228-472e-a74b-89ec0e006c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f611b2b-8228-472e-a74b-89ec0e006c36', 'volume_size': 1} Jul 08 18:24:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:31 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 1G" returned: 0 in 0.874s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:31 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 Jul 08 18:24:31 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-672a0da2-2e18-47f2-9eeb-88af4914bc11 req-a1233aa1-350c-49f5-a483-a97e16cd62bc tempest-TestInstancesWithCinderVolumes-1599322074 None] Terminate volume connection completed successfully. Jul 08 18:24:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-672a0da2-2e18-47f2-9eeb-88af4914bc11 req-a1233aa1-350c-49f5-a483-a97e16cd62bc tempest-TestInstancesWithCinderVolumes-1599322074 None] Deleting attachment b7dfc50a-f4da-4349-a49d-9e6763e24de3. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:24:31 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7" returned: 0 in 0.737s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:31 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 is being set with open permissions: ugo+rw Jul 08 18:24:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:31 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 Jul 08 18:24:31 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:32 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7" returned: 0 in 0.642s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:32 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.info Jul 08 18:24:32 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "cinder-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:33 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.info" returned: 0 in 0.692s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:33 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.info is being set with open permissions: ugo+rw Jul 08 18:24:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:33 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.info Jul 08 18:24:33 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "cinder-quobyte-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-quobyte-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d" acquired by "delete_volume" :: waited 0.034s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6df890-8f21-4cae-97a7-530989bcda3c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:33 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d Jul 08 18:24:33 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:34 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.info" returned: 0 in 0.741s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.570s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.517s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e91aa72b-0784-468d-a1fa-6e54daccb470,created_at=2026-07-08T16:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003331226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e91aa72b-0784-468d-a1fa-6e54daccb470,host='devstack@QuobyteHD#QuobyteHD',id=4f611b2b-8228-472e-a74b-89ec0e006c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648278fe867c4d19a1b99de7145a1104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:24:30Z,use_quota=True,user_id='b34ff75932924328b4c84f307de80fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70fec01f-048a-4153-b04c-9e09bdd3f8a6),volume_type_id=70fec01f-048a-4153-b04c-9e09bdd3f8a6)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Creating volume 4f611b2b-8228-472e-a74b-89ec0e006c36 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:24:34 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:34 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 1073741824 Jul 08 18:24:34 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:34 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dd7fe152-9740-4311-afed-6f2c14c3776d tempest-SnapshotMetadataTestJSON-285566209 None] Create snapshot completed successfully Jul 08 18:24:34 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d" returned: 0 in 0.906s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:34 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d Jul 08 18:24:34 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:35 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d" returned: 0 in 0.868s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-quobyte-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d" released by "delete_volume" :: held 1.845s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:35 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 1073741824" returned: 0 in 1.163s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:35 devstack cinder-volume[87309]: WARNING cinder.quota [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471945007-1599260445 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471945007-1599260445, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:35 devstack cinder-volume[87309]: WARNING cinder.quota [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471945007-1599260445 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471945007-1599260445, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Created reservations ['9eace94c-1fae-4186-a106-4b3eae038961', '44c86b1b-694b-42bd-8bb1-8d7aa3c41158', '27a34af0-89bb-4e32-97e4-161496433cca', '8c1ed481-b230-4cff-9113-ccb69b886240'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:35 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 Jul 08 18:24:35 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:35 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:35 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "cinder-a23c0434-e660-425d-8b27-c9e32ca764a7-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-a23c0434-e660-425d-8b27-c9e32ca764a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "cinder-quobyte-b0773c34-2eac-4fc9-a683-1e02a51f0087" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-quobyte-b0773c34-2eac-4fc9-a683-1e02a51f0087" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "cinder-quobyte-a23c0434-e660-425d-8b27-c9e32ca764a7" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-quobyte-a23c0434-e660-425d-8b27-c9e32ca764a7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Deleting offline snapshot a23c0434-e660-425d-8b27-c9e32ca764a7 of volume b0773c34-2eac-4fc9-a683-1e02a51f0087 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:24:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] snapshot_file for this snap is: volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[085086c8-e5bb-40de-b77b-37b8b8e1973c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:36 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 Jul 08 18:24:36 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:36 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36" returned: 0 in 0.953s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541bb54a-d9ed-4ccf-8765-e4fe88b85cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f611b2b-8228-472e-a74b-89ec0e006c36', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e47c4fb-f9ba-4b50-8ede-cc2548084811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:36 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Volume volume-4f611b2b-8228-472e-a74b-89ec0e006c36 (4f611b2b-8228-472e-a74b-89ec0e006c36): created successfully Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e47c4fb-f9ba-4b50-8ede-cc2548084811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Flow 'volume_create_manager' (19644446-692a-406f-9cb0-bed49bd7f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ae90d8d4-37cc-479b-89d7-f9f98f648f10 tempest-GroupSnapshotsTest-846799256 None] Created volume successfully. Jul 08 18:24:36 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.995s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deleted volume successfully. Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3261255-0635-4af8-a0ca-a9487299e6e9 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-8f4d9a8f-6ad8-495a-94db-fa3d598f5f5d-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:36 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7" returned: 0 in 0.813s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0773c34-2eac-4fc9-a683-1e02a51f0087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[748dfc79-d297-4762-80a3-b4bc4d119d60]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:36 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 Jul 08 18:24:36 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:37 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087" returned: 0 in 0.846s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:37 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 Jul 08 18:24:37 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] GroupSnapshot ceb2702c-8336-4c6b-8f5e-d373703a3024: creating. Jul 08 18:24:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Group snapshot ceb2702c-8336-4c6b-8f5e-d373703a3024: creating. {{(pid=87309) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 18:24:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Creating offline snapshot 81ec0651-c53f-41f1-9856-53f4d0ebab37 of volume 4f611b2b-8228-472e-a74b-89ec0e006c36 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:24:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e13aa14-7514-4f58-97c1-9ec1827a7200]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:38 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 Jul 08 18:24:38 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:38 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7" returned: 0 in 1.086s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:38 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7 Jul 08 18:24:38 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:38 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36" returned: 0 in 0.941s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:39 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 1G Jul 08 18:24:39 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:39 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087.a23c0434-e660-425d-8b27-c9e32ca764a7" returned: 0 in 0.827s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-quobyte-a23c0434-e660-425d-8b27-c9e32ca764a7" released by "_delete_snapshot" :: held 3.715s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-quobyte-b0773c34-2eac-4fc9-a683-1e02a51f0087" released by "delete_snapshot" :: held 3.751s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:39 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Created reservations ['975c2085-7768-4be1-8c76-77be3dfc51fa', '8a4ec3de-0190-43aa-8011-5ac13083d0a5', '3bd45404-f3b7-446e-95f1-0f61adb64240', 'c2007c73-fed1-4176-8f99-7d3850f66148'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:39 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Delete snapshot completed successfully. Jul 08 18:24:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e90534af-bf16-410b-88b4-72fae4ffd06b tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-a23c0434-e660-425d-8b27-c9e32ca764a7-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:39 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 1G" returned: 0 in 0.961s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f611b2b-8228-472e-a74b-89ec0e006c36 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:39 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f611b2b-8228-472e-a74b-89ec0e006c36 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 Jul 08 18:24:39 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "cinder-b0773c34-2eac-4fc9-a683-1e02a51f0087-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-b0773c34-2eac-4fc9-a683-1e02a51f0087-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "cinder-quobyte-b0773c34-2eac-4fc9-a683-1e02a51f0087" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-quobyte-b0773c34-2eac-4fc9-a683-1e02a51f0087" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-8c69bfc9-6dca-4691-b4e9-e2b621234356 req-2c988483-42b7-4829-a187-d857522b365b tempest-TestInstancesWithCinderVolumes-1599322074 None] Terminate volume connection completed successfully. Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-8c69bfc9-6dca-4691-b4e9-e2b621234356 req-2c988483-42b7-4829-a187-d857522b365b tempest-TestInstancesWithCinderVolumes-1599322074 None] Deleting attachment e2729e49-3acc-4156-a7c4-072991147bf5. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[114c5e48-44ff-42f3-b102-d3da1de89e2b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:40 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 Jul 08 18:24:40 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:40 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f611b2b-8228-472e-a74b-89ec0e006c36 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37" returned: 0 in 0.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:40 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:24:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:40 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 Jul 08 18:24:40 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:41 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:41 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087 Jul 08 18:24:41 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:41 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37" returned: 0 in 0.727s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:41 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.info Jul 08 18:24:41 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:41 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b0773c34-2eac-4fc9-a683-1e02a51f0087" returned: 0 in 0.646s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-quobyte-b0773c34-2eac-4fc9-a683-1e02a51f0087" released by "delete_volume" :: held 1.551s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Created reservations ['3e917f39-7954-4dae-9c47-894e8051096e', '9a625236-9eca-43fe-9da6-dff4cc729d4a', '108b73a4-2a6c-4da3-bf70-a0c113291353', '9a35d690-d9a3-40d8-982f-c6f245725635'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:41 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:41 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:42 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.info" returned: 0 in 0.689s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:42 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 18:24:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:42 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.info Jul 08 18:24:42 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:42 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.635s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:42 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Deleted volume successfully. Jul 08 18:24:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ad419c40-eb16-4ab3-a69a-02b804231100 tempest-SnapshotMetadataTestJSON-285566209 None] Lock "cinder-b0773c34-2eac-4fc9-a683-1e02a51f0087-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:42 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.info" returned: 0 in 0.654s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.820s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-83d304eb-6a59-4ec8-a424-587f0876828a tempest-GroupSnapshotsTest-846799256 None] group_snapshot ceb2702c-8336-4c6b-8f5e-d373703a3024: created successfully Jul 08 18:24:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] group_snapshot ceb2702c-8336-4c6b-8f5e-d373703a3024: deleting Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] group_snapshot ceb2702c-8336-4c6b-8f5e-d373703a3024: deleting {{(pid=87309) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-4f611b2b-8228-472e-a74b-89ec0e006c36" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-4f611b2b-8228-472e-a74b-89ec0e006c36" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-81ec0651-c53f-41f1-9856-53f4d0ebab37" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-81ec0651-c53f-41f1-9856-53f4d0ebab37" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Deleting offline snapshot 81ec0651-c53f-41f1-9856-53f4d0ebab37 of volume 4f611b2b-8228-472e-a74b-89ec0e006c36 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] snapshot_file for this snap is: volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "cinder-f9959bd1-cece-40c2-98d3-2bf64ddf5a70-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-f9959bd1-cece-40c2-98d3-2bf64ddf5a70-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6043bb-6030-4926-ba04-823a9b78ac45]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "cinder-quobyte-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-quobyte-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a61cf-9eec-4995-9179-1a04cb4e3da5]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:43 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 Jul 08 18:24:43 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:43 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:24:43 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:44 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37" returned: 0 in 0.992s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:44 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f611b2b-8228-472e-a74b-89ec0e006c36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:24:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 0 in 0.872s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5f161f-d342-420b-bc6f-0c4fad982eee]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:44 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:24:44 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 Jul 08 18:24:44 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:44 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:45 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 1 in 0.828s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:24:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:45 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70 Jul 08 18:24:45 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:45 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36" returned: 0 in 0.870s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:45 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 Jul 08 18:24:45 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:46 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" returned: 0 in 0.751s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-quobyte-f9959bd1-cece-40c2-98d3-2bf64ddf5a70" released by "delete_volume" :: held 2.525s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:46 devstack cinder-volume[87309]: WARNING cinder.quota [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1897658525-998593048 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1897658525-998593048, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:46 devstack cinder-volume[87309]: WARNING cinder.quota [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1897658525-998593048 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1897658525-998593048, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Created reservations ['96f277ec-da75-4aac-87c4-ed68887f0a43', 'cfbe81d0-d042-4af9-84e1-7772de3cb7b4', '44b4c139-ae8b-473a-bf82-ff9bff208c58', '2173c498-a787-4d2e-9256-d406f60e4019'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:46 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37" returned: 0 in 0.799s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:46 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37 Jul 08 18:24:46 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:46 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:46 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:46 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36.81ec0651-c53f-41f1-9856-53f4d0ebab37" returned: 0 in 0.769s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-81ec0651-c53f-41f1-9856-53f4d0ebab37" released by "_delete_snapshot" :: held 3.578s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-4f611b2b-8228-472e-a74b-89ec0e006c36" released by "delete_snapshot" :: held 3.601s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:47 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.753s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:47 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Deleted volume successfully. Jul 08 18:24:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-413fadf4-207f-45bf-9fdd-3e0961906c67 tempest-TestInstancesWithCinderVolumes-1599322074 None] Lock "cinder-f9959bd1-cece-40c2-98d3-2bf64ddf5a70-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:47 devstack cinder-volume[87309]: WARNING cinder.quota [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1368243775 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1368243775, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:47 devstack cinder-volume[87309]: WARNING cinder.quota [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1368243775 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1368243775, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:47 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] Created reservations ['d69e6fbf-9fa7-4cbf-b92c-c36e109040b6', '62f3c64b-cc83-44be-b25b-b48e61ae3aa1', '8fb4f649-6cf7-4fc0-9212-41bcdad557ae', '507b6939-6bf7-45db-b5b0-37323398ab92'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-92fd4725-18c8-4f1c-8c38-3a517d1404e4 tempest-GroupSnapshotsTest-846799256 None] group_snapshot ceb2702c-8336-4c6b-8f5e-d373703a3024: deleted successfully Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "cinder-quobyte-4f611b2b-8228-472e-a74b-89ec0e006c36" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-4f611b2b-8228-472e-a74b-89ec0e006c36" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[133d6f40-335c-4f6a-9f81-6043be88277e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:48 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 Jul 08 18:24:48 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (bc4145c2-b04c-4aec-bf5e-608b70809670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc6d8cf-fd33-474c-9ca5-076926524487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc6d8cf-fd33-474c-9ca5-076926524487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-160214089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f81a577-f3d3-4b9a-8f40-6e9b3171e062,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:24:49Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8145df-5c37-40d3-af24-8c063f401e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8145df-5c37-40d3-af24-8c063f401e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffffb318-cb3c-4978-b7b0-f8651711d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffffb318-cb3c-4978-b7b0-f8651711d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f81a577-f3d3-4b9a-8f40-6e9b3171e062', 'volume_name': 'volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7721f4-15a5-4e0f-b4c6-fd4e0801b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7721f4-15a5-4e0f-b4c6-fd4e0801b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2a1103-3a67-4b2d-b8d8-0eb7162606d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:48 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Volume 8f81a577-f3d3-4b9a-8f40-6e9b3171e062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062', 'volume_size': 1} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-160214089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f81a577-f3d3-4b9a-8f40-6e9b3171e062,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:24:49Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Creating volume 8f81a577-f3d3-4b9a-8f40-6e9b3171e062 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:24:48 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:24:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:48 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 1073741824 Jul 08 18:24:48 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:49 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36" returned: 0 in 0.858s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:49 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36 Jul 08 18:24:49 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:49 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 1073741824" returned: 0 in 1.042s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:49 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 Jul 08 18:24:49 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:50 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4f611b2b-8228-472e-a74b-89ec0e006c36" returned: 0 in 0.873s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Lock "cinder-quobyte-4f611b2b-8228-472e-a74b-89ec0e006c36" released by "delete_volume" :: held 1.835s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Created reservations ['bd3b3a9f-07c5-430e-b3ae-b19c5f48ed58'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:50 devstack cinder-volume[87309]: WARNING cinder.quota [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1368243775 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1368243775, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Created reservations ['593adce5-6ab2-4fe9-8f75-8debb3921f57', 'd3c474fb-11a2-4de8-a57f-797c82a1567c', '01e2048e-67ca-4e17-bc96-b26d9837ef23', '7ef94a9e-f1be-4518-9063-cb18266e5ee0'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:50 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:50 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:50 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062" returned: 0 in 0.781s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2a1103-3a67-4b2d-b8d8-0eb7162606d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01a4856-116a-47ed-84cd-aef1e55e2028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Volume volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 (8f81a577-f3d3-4b9a-8f40-6e9b3171e062): created successfully Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01a4856-116a-47ed-84cd-aef1e55e2028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (bc4145c2-b04c-4aec-bf5e-608b70809670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-598785f1-e414-4569-bc22-82c46ab85c9d tempest-VolumesGetTest-1528360743 None] Created volume successfully. Jul 08 18:24:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-486bd617-afce-4282-83f0-b2eb81480bcc req-dab4631c-3f14-4494-8d18-7cf3b82a794d tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-486bd617-afce-4282-83f0-b2eb81480bcc req-dab4631c-3f14-4494-8d18-7cf3b82a794d tempest-TestStampPattern-640461682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[95645b22-5afa-4abf-a0e0-ae73a6cd5dc2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-486bd617-afce-4282-83f0-b2eb81480bcc req-dab4631c-3f14-4494-8d18-7cf3b82a794d tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:51 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.807s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:51 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4f68d146-817d-4352-8de6-de00edd2ab3c tempest-GroupSnapshotsTest-846799256 None] Delete group completed successfully. Jul 08 18:24:51 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 Jul 08 18:24:51 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:52 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-486bd617-afce-4282-83f0-b2eb81480bcc req-dab4631c-3f14-4494-8d18-7cf3b82a794d tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9" returned: 0 in 1.076s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-486bd617-afce-4282-83f0-b2eb81480bcc req-dab4631c-3f14-4494-8d18-7cf3b82a794d tempest-TestStampPattern-640461682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.104s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-486bd617-afce-4282-83f0-b2eb81480bcc req-dab4631c-3f14-4494-8d18-7cf3b82a794d tempest-TestStampPattern-640461682 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07692db5-76c2-4a2a-9ccb-a34e46b06b00', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:24:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-486bd617-afce-4282-83f0-b2eb81480bcc req-dab4631c-3f14-4494-8d18-7cf3b82a794d tempest-TestStampPattern-640461682 None] attachment_update completed successfully. Jul 08 18:24:52 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:24:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (247fb08f-fcf9-4ca2-8fd7-261a5e02fc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5743ff21-7c75-4eb4-8401-fbb791626c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5743ff21-7c75-4eb4-8401-fbb791626c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:24:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-902999648',display_name='tempest-VolumesGetTest-Volume-901135340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9305af2-e456-4ee5-bb49-997e87baf015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:24:53Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6892ff7-c88b-45df-92c0-02b11d1c5df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6892ff7-c88b-45df-92c0-02b11d1c5df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf3a896-38c8-47c4-ab00-b001c6a9604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf3a896-38c8-47c4-ab00-b001c6a9604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9305af2-e456-4ee5-bb49-997e87baf015', 'volume_name': 'volume-e9305af2-e456-4ee5-bb49-997e87baf015', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da51784-bfb2-469e-b1e0-8186eba31829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da51784-bfb2-469e-b1e0-8186eba31829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac35b193-07b4-467a-b66b-35a9e9cb125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:53 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Volume e9305af2-e456-4ee5-bb49-997e87baf015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9305af2-e456-4ee5-bb49-997e87baf015', 'volume_size': 1} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:24:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-902999648',display_name='tempest-VolumesGetTest-Volume-901135340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9305af2-e456-4ee5-bb49-997e87baf015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:24:53Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Creating volume e9305af2-e456-4ee5-bb49-997e87baf015 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:24:53 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:24:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:53 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 1073741824 Jul 08 18:24:53 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:54 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 1073741824" returned: 0 in 1.127s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:54 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 Jul 08 18:24:54 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:55 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015" returned: 0 in 0.880s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:24:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac35b193-07b4-467a-b66b-35a9e9cb125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9305af2-e456-4ee5-bb49-997e87baf015', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b048846-c1b5-4255-befb-7a63368b9fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:24:55 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Volume volume-e9305af2-e456-4ee5-bb49-997e87baf015 (e9305af2-e456-4ee5-bb49-997e87baf015): created successfully Jul 08 18:24:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b048846-c1b5-4255-befb-7a63368b9fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:24:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (247fb08f-fcf9-4ca2-8fd7-261a5e02fc2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:24:55 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4bd0680a-e870-4423-993a-fa8d11354656 tempest-VolumesGetTest-1528360743 None] Created volume successfully. Jul 08 18:24:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-e9305af2-e456-4ee5-bb49-997e87baf015-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Lock "cinder-e9305af2-e456-4ee5-bb49-997e87baf015-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-e9305af2-e456-4ee5-bb49-997e87baf015" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-e9305af2-e456-4ee5-bb49-997e87baf015" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:56 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[340f87a3-b84b-49ee-8e53-551de8d0ea0a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:56 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 Jul 08 18:24:56 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:57 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015" returned: 0 in 1.053s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:57 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015 Jul 08 18:24:57 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:58 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e9305af2-e456-4ee5-bb49-997e87baf015" returned: 0 in 0.805s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-e9305af2-e456-4ee5-bb49-997e87baf015" released by "delete_volume" :: held 1.928s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Created reservations ['187cf89d-2ecb-407c-8fd1-d688a762f77c', '72504b06-30f2-4c8d-abc9-4416b52e17cd', 'e3000ee3-26e8-4130-ba45-8a53bec59f12', '1db705ca-77e7-452b-bbaa-b4ed03423033'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:58 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:24:58 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-8f81a577-f3d3-4b9a-8f40-6e9b3171e062-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Lock "cinder-8f81a577-f3d3-4b9a-8f40-6e9b3171e062-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-8f81a577-f3d3-4b9a-8f40-6e9b3171e062" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-8f81a577-f3d3-4b9a-8f40-6e9b3171e062" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[58135206-b1d5-4411-9b96-d0e632b9a64e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:24:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:58 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 Jul 08 18:24:58 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:24:59 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.945s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:59 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:24:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Deleted volume successfully. Jul 08 18:24:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-faa17ebc-254f-431c-90c7-67a945ca567f tempest-VolumesGetTest-1528360743 None] Lock "cinder-e9305af2-e456-4ee5-bb49-997e87baf015-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:24:59 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 08 18:24:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062" returned: 0 in 1.102s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:24:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:24:59 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062 Jul 08 18:24:59 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-a8b05522-8e3f-49f6-815e-a1e4ff61b092 req-06d0b8a2-7e89-4c0f-af58-680d69143134 tempest-TestStampPattern-640461682 None] Terminate volume connection completed successfully. Jul 08 18:25:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-a8b05522-8e3f-49f6-815e-a1e4ff61b092 req-06d0b8a2-7e89-4c0f-af58-680d69143134 tempest-TestStampPattern-640461682 None] Deleting attachment 07692db5-76c2-4a2a-9ccb-a34e46b06b00. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:25:00 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8f81a577-f3d3-4b9a-8f40-6e9b3171e062" returned: 0 in 0.904s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-8f81a577-f3d3-4b9a-8f40-6e9b3171e062" released by "delete_volume" :: held 2.063s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:00 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Created reservations ['f33c8b13-7c85-4916-8361-780fefffbcea', '20a9d861-e082-4a79-a0f1-39c4e96356a4', 'ee2fb29d-078e-4873-92f6-a9e6efbe33fb', '07d35568-0c84-47f5-b7e4-1e6777fbc1aa'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:01 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:01 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:01 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.738s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:01 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Deleted volume successfully. Jul 08 18:25:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f719a733-a508-421c-ac5d-635fe7624855 tempest-VolumesGetTest-1528360743 None] Lock "cinder-8f81a577-f3d3-4b9a-8f40-6e9b3171e062-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:02 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:02 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (caf48673-bde6-4227-9e45-3b5999b4915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c962bb36-cb29-4aad-8f53-7b562ac87fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c962bb36-cb29-4aad-8f53-7b562ac87fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1781429602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:03Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3db2f03-bbbe-4af1-9a90-1f8473f57b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3db2f03-bbbe-4af1-9a90-1f8473f57b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28b90fc-0c9a-44bd-a51d-04911ce88f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28b90fc-0c9a-44bd-a51d-04911ce88f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde', 'volume_name': 'volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6893db72-818c-464b-82ab-014b1e8e1b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6893db72-818c-464b-82ab-014b1e8e1b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e442b85-0c08-4499-a66c-aa728baedd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:02 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Volume 4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde', 'volume_size': 1} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1781429602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:03Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Creating volume 4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:02 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:02 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde 1073741824 Jul 08 18:25:02 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:03 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.404s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:25:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:25:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:25:04 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde 1073741824" returned: 0 in 1.295s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:04 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde Jul 08 18:25:04 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:04 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" returned: 0 in 0.741s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e442b85-0c08-4499-a66c-aa728baedd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573116c5-824b-47aa-a5ab-02fed8fc8cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Volume volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde (4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde): created successfully Jul 08 18:25:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573116c5-824b-47aa-a5ab-02fed8fc8cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (caf48673-bde6-4227-9e45-3b5999b4915f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:05 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-68f7df05-4629-45e0-8ac9-d2b34ff83c2e tempest-VolumesGetTest-1528360743 None] Created volume successfully. Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (e599f918-8272-4c88-a017-3eacd479cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a322f8bb-8027-4666-9f30-f1d73a3fc9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a322f8bb-8027-4666-9f30-f1d73a3fc9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-84114219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da02527e-f995-42c0-b044-5de956bc852f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:06Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2288b040-eede-4160-a81b-64c89b4a5a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2288b040-eede-4160-a81b-64c89b4a5a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dcbba6-10b0-4d8d-8396-5676aaccf062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dcbba6-10b0-4d8d-8396-5676aaccf062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'da02527e-f995-42c0-b044-5de956bc852f', 'volume_name': 'volume-da02527e-f995-42c0-b044-5de956bc852f', 'volume_size': 1, 'source_volid': '4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde', 'source_volstatus': 'available'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347f0e79-d8ed-492a-99ed-26f32dca7d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347f0e79-d8ed-492a-99ed-26f32dca7d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2539fb-2fe1-40a0-87e3-2c499894e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:06 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Volume da02527e-f995-42c0-b044-5de956bc852f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-da02527e-f995-42c0-b044-5de956bc852f', 'volume_size': 1, 'source_volid': '4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde', 'source_volstatus': 'available'} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:06 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Cloning volume 4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde to volume da02527e-f995-42c0-b044-5de956bc852f Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Creating offline snapshot 2906350d-758f-4f72-8e95-70d430268723 of volume 4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c83b416-4b27-4dfc-b21a-14e18c1400c3]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:06 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde Jul 08 18:25:06 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:07 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" returned: 0 in 1.178s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:07 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 1G Jul 08 18:25:07 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:08 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 1G" returned: 0 in 1.035s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:09 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 Jul 08 18:25:09 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:09 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723" returned: 0 in 0.857s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:09 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 is being set with open permissions: ugo+rw Jul 08 18:25:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:09 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 Jul 08 18:25:09 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:10 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723" returned: 0 in 0.745s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:10 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.info Jul 08 18:25:10 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-857bd52e-2a97-4b6e-98f5-4305cc5742c9-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Lock "cinder-857bd52e-2a97-4b6e-98f5-4305cc5742c9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-quobyte-857bd52e-2a97-4b6e-98f5-4305cc5742c9" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-857bd52e-2a97-4b6e-98f5-4305cc5742c9" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1765d6dd-c29b-4bcd-a3fb-3a1fa15338d6]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:11 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 Jul 08 18:25:11 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:11 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.info" returned: 0 in 0.853s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:11 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.info is being set with open permissions: ugo+rw Jul 08 18:25:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:11 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.info Jul 08 18:25:11 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:11 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9" returned: 0 in 0.982s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:11 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9 Jul 08 18:25:11 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:12 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.info" returned: 0 in 0.947s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-da02527e-f995-42c0-b044-5de956bc852f" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-da02527e-f995-42c0-b044-5de956bc852f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] snapshot: 2906350d-758f-4f72-8e95-70d430268723, volume: da02527e-f995-42c0-b044-5de956bc852f, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d808b5-aa76-45a0-8023-741a9af7d9ff]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:12 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 Jul 08 18:25:12 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:12 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-857bd52e-2a97-4b6e-98f5-4305cc5742c9" returned: 0 in 0.922s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-857bd52e-2a97-4b6e-98f5-4305cc5742c9" released by "delete_volume" :: held 1.976s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Created reservations ['d86cd589-3d59-4b7d-a1b9-01406ff006a2', '641cf4b6-e3bd-4cb9-b010-6583acb1ad63', '095a6524-536e-4fa8-b25a-e9849b66b59c', '36ffcc61-0909-4e0b-84cb-8360c8a375cc'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:13 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:13 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-36f51181-988d-4adc-804f-0f7f34c88dc1-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Lock "cinder-36f51181-988d-4adc-804f-0f7f34c88dc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-quobyte-69996024-2cab-4a03-a507-281f2d4ede13" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-69996024-2cab-4a03-a507-281f2d4ede13" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-quobyte-36f51181-988d-4adc-804f-0f7f34c88dc1" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-36f51181-988d-4adc-804f-0f7f34c88dc1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Deleting offline snapshot 36f51181-988d-4adc-804f-0f7f34c88dc1 of volume 69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] snapshot_file for this snap is: volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[89946d47-98dd-4b0a-950d-99522e9c4947]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:13 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Flow 'volume_create_manager' (fbe7a348-f83d-47ba-8cbf-4b89ddbf39fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69862be7-f93e-439f-9ac9-3ec1974d6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723" returned: 0 in 1.207s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00617fc-9166-4764-803b-388727ae4b05]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:13 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 Jul 08 18:25:13 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69862be7-f93e-439f-9ac9-3ec1974d6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1810955716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65afc7f-ce8a-4717-8f29-a703e28839ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b1f09098fc4b3197ec045dea74c48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:14Z,use_quota=True,user_id='a4fb669a4d3841f4873c881401b9fae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e988b92-b11e-46ba-bc31-318cc9c22868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e988b92-b11e-46ba-bc31-318cc9c22868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea85064f-6e7f-4dce-88bc-47ea5f76cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea85064f-6e7f-4dce-88bc-47ea5f76cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65afc7f-ce8a-4717-8f29-a703e28839ee', 'volume_name': 'volume-d65afc7f-ce8a-4717-8f29-a703e28839ee', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9f0522-ad18-4985-b3b8-64e7adc52b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9f0522-ad18-4985-b3b8-64e7adc52b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b151ccb4-7d9b-42f5-9ff8-aa3b81e6eb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:13 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Volume d65afc7f-ce8a-4717-8f29-a703e28839ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65afc7f-ce8a-4717-8f29-a703e28839ee', 'volume_size': 1} Jul 08 18:25:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:13 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde Jul 08 18:25:13 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:14 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.066s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Deleted volume successfully. Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-18bb7fe1-e1d9-45e2-acad-2ae89e6ce327 tempest-TestStampPattern-640461682 None] Lock "cinder-857bd52e-2a97-4b6e-98f5-4305cc5742c9-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:14 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1" returned: 0 in 0.883s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69996024-2cab-4a03-a507-281f2d4ede13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadd9c91-0f5b-4f67-bd52-3e1292195c1b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:14 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 Jul 08 18:25:14 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:14 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" returned: 0 in 0.992s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:25:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:14 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f Jul 08 18:25:14 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:15 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13" returned: 0 in 1.019s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:15 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 Jul 08 18:25:15 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:17 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1" returned: 0 in 1.840s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:17 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1 Jul 08 18:25:17 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:19 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13.36f51181-988d-4adc-804f-0f7f34c88dc1" returned: 0 in 1.652s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-36f51181-988d-4adc-804f-0f7f34c88dc1" released by "_delete_snapshot" :: held 5.639s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-69996024-2cab-4a03-a507-281f2d4ede13" released by "delete_snapshot" :: held 5.679s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:19 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Created reservations ['3968a416-6a75-43c0-880c-f314a06eb8cf', '25a618d5-655d-42b8-8248-fae65c0e197a', 'c360cfa3-3b6e-4dbe-a1af-7ce6df794b54', '89f48c16-b5d6-4505-afa8-e59501a2f503'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:19 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Delete snapshot completed successfully. Jul 08 18:25:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ddf4aa40-a498-4310-a770-d038aaaacf90 tempest-TestStampPattern-640461682 None] Lock "cinder-36f51181-988d-4adc-804f-0f7f34c88dc1-delete_snapshot" released by "delete_snapshot" :: held 6.015s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:20 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f" returned: 0 in 5.955s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:20 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b311ae6e-8674-40dd-b249-31c33e1ab571]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:20 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde Jul 08 18:25:20 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:21 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" returned: 0 in 1.056s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:21 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:25:21 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Converted 1024.00 MB image at 171.94 MB/s Jul 08 18:25:21 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f is being set with open permissions: ugo+rw Jul 08 18:25:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:21 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f Jul 08 18:25:21 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:22 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f" returned: 0 in 0.757s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-da02527e-f995-42c0-b044-5de956bc852f" released by "_copy_volume_from_snapshot" :: held 10.077s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-2906350d-758f-4f72-8e95-70d430268723" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-2906350d-758f-4f72-8e95-70d430268723" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Deleting offline snapshot 2906350d-758f-4f72-8e95-70d430268723 of volume 4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:25:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] snapshot_file for this snap is: volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:25:22 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa325931-7f8d-46e6-b64e-1d9f43305c15]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:22 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 Jul 08 18:25:22 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:23 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723" returned: 0 in 1.023s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:25:23 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d690696c-d970-488f-9720-0c7562b672bb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:23 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde Jul 08 18:25:23 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:24 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" returned: 0 in 0.886s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:24 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 Jul 08 18:25:24 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:25 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723" returned: 0 in 0.970s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:25 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723 Jul 08 18:25:25 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:26 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde.2906350d-758f-4f72-8e95-70d430268723" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-2906350d-758f-4f72-8e95-70d430268723" released by "_delete_snapshot" :: held 3.834s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.759s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.649s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1810955716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65afc7f-ce8a-4717-8f29-a703e28839ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b1f09098fc4b3197ec045dea74c48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:14Z,use_quota=True,user_id='a4fb669a4d3841f4873c881401b9fae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Creating volume d65afc7f-ce8a-4717-8f29-a703e28839ee {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:26 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2539fb-2fe1-40a0-87e3-2c499894e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da02527e-f995-42c0-b044-5de956bc852f', 'volume_size': 1, 'source_volid': '4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde', 'source_volstatus': 'available'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2161bfb8-3ef8-4d65-b767-482008c1264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:26 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee 1073741824 Jul 08 18:25:26 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:26 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Volume volume-da02527e-f995-42c0-b044-5de956bc852f (da02527e-f995-42c0-b044-5de956bc852f): created successfully Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2161bfb8-3ef8-4d65-b767-482008c1264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (e599f918-8272-4c88-a017-3eacd479cd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:26 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3bfaa880-3751-4b1e-b719-285fad1c64db tempest-VolumesGetTest-1528360743 None] Created volume successfully. Jul 08 18:25:27 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee 1073741824" returned: 0 in 1.021s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:27 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee Jul 08 18:25:27 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:28 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee" returned: 0 in 0.816s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b151ccb4-7d9b-42f5-9ff8-aa3b81e6eb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65afc7f-ce8a-4717-8f29-a703e28839ee', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969c8265-efa1-4546-9b94-8f5babd32f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:28 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Volume volume-d65afc7f-ce8a-4717-8f29-a703e28839ee (d65afc7f-ce8a-4717-8f29-a703e28839ee): created successfully Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969c8265-efa1-4546-9b94-8f5babd32f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Flow 'volume_create_manager' (fbe7a348-f83d-47ba-8cbf-4b89ddbf39fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-605dac84-7fa8-4f03-8099-788adedee1f4 tempest-VolumesListAdminTestJSON-651026052 None] Created volume successfully. Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-69996024-2cab-4a03-a507-281f2d4ede13-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Lock "cinder-69996024-2cab-4a03-a507-281f2d4ede13-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (1eccbfb8-c3e6-487b-bde8-ebf2376c792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f451431e-6e76-47c5-b524-5555bacc2f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f451431e-6e76-47c5-b524-5555bacc2f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-136255750',display_name='tempest-VolumesGetTest-Volume-2012333957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b99649-5c7d-4089-aa77-0028b8ab7fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:28Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcef3a9d-8792-4386-8a44-4c5618c0fbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcef3a9d-8792-4386-8a44-4c5618c0fbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3f4532-5cbc-47ef-aece-83879ca78f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3f4532-5cbc-47ef-aece-83879ca78f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b99649-5c7d-4089-aa77-0028b8ab7fde', 'volume_name': 'volume-89b99649-5c7d-4089-aa77-0028b8ab7fde', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a545e10-1187-4bcd-9f41-a2b1afa3a7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a545e10-1187-4bcd-9f41-a2b1afa3a7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933dad73-9c53-443c-92ae-bf196fe30f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:28 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Volume 89b99649-5c7d-4089-aa77-0028b8ab7fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b99649-5c7d-4089-aa77-0028b8ab7fde', 'volume_size': 1} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-136255750',display_name='tempest-VolumesGetTest-Volume-2012333957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b99649-5c7d-4089-aa77-0028b8ab7fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:28Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Creating volume 89b99649-5c7d-4089-aa77-0028b8ab7fde {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:28 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:28 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde 1073741824 Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Acquiring lock "cinder-quobyte-69996024-2cab-4a03-a507-281f2d4ede13" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:28 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-69996024-2cab-4a03-a507-281f2d4ede13" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5728b0d0-eab6-4702-833e-f9a5a3fee667]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:28 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 Jul 08 18:25:28 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:29 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13" returned: 0 in 1.108s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:29 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13 Jul 08 18:25:29 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:29 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde 1073741824" returned: 0 in 1.324s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:30 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde Jul 08 18:25:30 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Flow 'volume_create_manager' (31ff0996-aea0-461f-9069-ff428688f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35daaa0c-7778-4807-99f7-d66dcbde7b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35daaa0c-7778-4807-99f7-d66dcbde7b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1140534009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b599c4d8-93d3-4d76-a735-93e1ca95ab11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b1f09098fc4b3197ec045dea74c48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:30Z,use_quota=True,user_id='a4fb669a4d3841f4873c881401b9fae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f52064-1f8f-4f84-997f-db465eafdfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f52064-1f8f-4f84-997f-db465eafdfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8b0f30-6bc2-4383-88ef-73a25a72c401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8b0f30-6bc2-4383-88ef-73a25a72c401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b599c4d8-93d3-4d76-a735-93e1ca95ab11', 'volume_name': 'volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cb5e5a-04a1-4093-b712-184990db3fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cb5e5a-04a1-4093-b712-184990db3fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba768885-ec50-4753-9e16-172a5d9ff2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:30 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Volume b599c4d8-93d3-4d76-a735-93e1ca95ab11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11', 'volume_size': 1} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:30 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-69996024-2cab-4a03-a507-281f2d4ede13" returned: 0 in 0.757s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Lock "cinder-quobyte-69996024-2cab-4a03-a507-281f2d4ede13" released by "delete_volume" :: held 1.947s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=93,cinder:UPDATE=99,cinder:DELETE=6,cinder:INSERT=30 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=93,cinder:UPDATE=106,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Created reservations ['e6f3f218-599e-4a42-835c-7a647338b821', '3abc624e-a769-44f5-b253-d11be7ad654a', 'e1e141b8-ab0f-4ffc-9bbc-283e9c4d713e', '15703d2a-8851-484a-a4a0-9272f8f338db'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:30 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde" returned: 0 in 0.797s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.634s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1140534009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b599c4d8-93d3-4d76-a735-93e1ca95ab11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b1f09098fc4b3197ec045dea74c48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:30Z,use_quota=True,user_id='a4fb669a4d3841f4873c881401b9fae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Creating volume b599c4d8-93d3-4d76-a735-93e1ca95ab11 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:30 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:30 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:30 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:30 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 1073741824 Jul 08 18:25:30 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933dad73-9c53-443c-92ae-bf196fe30f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b99649-5c7d-4089-aa77-0028b8ab7fde', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281b3107-45b3-461e-ac48-873362c266e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:30 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Volume volume-89b99649-5c7d-4089-aa77-0028b8ab7fde (89b99649-5c7d-4089-aa77-0028b8ab7fde): created successfully Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281b3107-45b3-461e-ac48-873362c266e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (1eccbfb8-c3e6-487b-bde8-ebf2376c792c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:30 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a362036f-d215-482b-8aca-f49990185ba2 tempest-VolumesGetTest-1528360743 None] Created volume successfully. Jul 08 18:25:31 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.873s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:31 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Deleted volume successfully. Jul 08 18:25:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ec543d65-d2ae-4478-8075-dfd382623350 tempest-TestStampPattern-640461682 None] Lock "cinder-69996024-2cab-4a03-a507-281f2d4ede13-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-89b99649-5c7d-4089-aa77-0028b8ab7fde-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Lock "cinder-89b99649-5c7d-4089-aa77-0028b8ab7fde-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-89b99649-5c7d-4089-aa77-0028b8ab7fde" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-89b99649-5c7d-4089-aa77-0028b8ab7fde" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afab532-c7e7-45cf-8d11-46c87121c7d6]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:32 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 1073741824" returned: 0 in 1.217s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:32 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 Jul 08 18:25:32 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:32 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde Jul 08 18:25:32 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:32 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11" returned: 0 in 0.714s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba768885-ec50-4753-9e16-172a5d9ff2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba19386-302d-4151-9f36-75bfa470f286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:32 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Volume volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 (b599c4d8-93d3-4d76-a735-93e1ca95ab11): created successfully Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba19386-302d-4151-9f36-75bfa470f286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Flow 'volume_create_manager' (31ff0996-aea0-461f-9069-ff428688f204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:32 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f560301d-0f76-47ff-88fc-39b53890031c tempest-VolumesListAdminTestJSON-651026052 None] Created volume successfully. Jul 08 18:25:32 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde" returned: 0 in 0.963s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:33 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde Jul 08 18:25:33 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:33 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-89b99649-5c7d-4089-aa77-0028b8ab7fde" returned: 0 in 0.917s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:33 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Flow 'volume_create_manager' (cc414603-a28d-43e8-96a6-b12c31e7d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595fca3c-f245-401c-a7e2-3806e8e74dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-89b99649-5c7d-4089-aa77-0028b8ab7fde" released by "delete_volume" :: held 1.971s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595fca3c-f245-401c-a7e2-3806e8e74dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1391713490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30b4f66-a71d-48e6-9474-d2b7b54bc41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b1f09098fc4b3197ec045dea74c48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:34Z,use_quota=True,user_id='a4fb669a4d3841f4873c881401b9fae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac817a4-15df-44a2-a206-f7b7c6119d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac817a4-15df-44a2-a206-f7b7c6119d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec9eea5-4c78-4648-8761-f169dae158d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec9eea5-4c78-4648-8761-f169dae158d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c30b4f66-a71d-48e6-9474-d2b7b54bc41c', 'volume_name': 'volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36ea1a8-c3df-4c1f-8bbf-dec078547ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36ea1a8-c3df-4c1f-8bbf-dec078547ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29339d05-dd21-46a3-b6ec-3082c76c1324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:34 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Volume c30b4f66-a71d-48e6-9474-d2b7b54bc41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c', 'volume_size': 1} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1391713490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30b4f66-a71d-48e6-9474-d2b7b54bc41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b1f09098fc4b3197ec045dea74c48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:34Z,use_quota=True,user_id='a4fb669a4d3841f4873c881401b9fae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Creating volume c30b4f66-a71d-48e6-9474-d2b7b54bc41c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:34 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:34 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c 1073741824 Jul 08 18:25:34 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Created reservations ['ec49e451-dc70-41e8-b81b-5d094dfd697d', 'd994f05c-e056-43f1-bf46-30d2bd1da07d', '8f831a82-1f20-4d1e-beaf-99f1c205890e', '2c7227ab-df37-4194-8759-068c3bd12437'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:34 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:34 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-da02527e-f995-42c0-b044-5de956bc852f-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Lock "cinder-da02527e-f995-42c0-b044-5de956bc852f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-da02527e-f995-42c0-b044-5de956bc852f" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-da02527e-f995-42c0-b044-5de956bc852f" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fc7635-c168-4570-b41e-31b6bb534c61]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:34 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f Jul 08 18:25:34 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:35 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.988s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:35 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Deleted volume successfully. Jul 08 18:25:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f7c9540f-7aac-4524-828f-114d2cec57b3 tempest-VolumesGetTest-1528360743 None] Lock "cinder-89b99649-5c7d-4089-aa77-0028b8ab7fde-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:35 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c 1073741824" returned: 0 in 1.344s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:35 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c Jul 08 18:25:35 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:35 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f" returned: 0 in 1.202s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:35 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f Jul 08 18:25:35 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:36 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c" returned: 0 in 0.780s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29339d05-dd21-46a3-b6ec-3082c76c1324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552375c4-646c-40c1-bd38-fd3114781fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:36 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Volume volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c (c30b4f66-a71d-48e6-9474-d2b7b54bc41c): created successfully Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552375c4-646c-40c1-bd38-fd3114781fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Flow 'volume_create_manager' (cc414603-a28d-43e8-96a6-b12c31e7d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1b50b926-e4db-4fb3-afc0-18e8ebccee4a tempest-VolumesListAdminTestJSON-651026052 None] Created volume successfully. Jul 08 18:25:36 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da02527e-f995-42c0-b044-5de956bc852f" returned: 0 in 0.782s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-da02527e-f995-42c0-b044-5de956bc852f" released by "delete_volume" :: held 2.054s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Created reservations ['91e98f89-55f4-4a50-b45c-a2ca19614f13', '502a461f-9281-4ccc-8078-de0cc74b534f', '58f0b0f0-e28b-4157-90ce-a6163e734814', '458843d8-b28f-4e2d-9519-ceb92bcc7a79'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:36 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:36 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:37 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.784s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:37 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Deleted volume successfully. Jul 08 18:25:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b3bb1c89-e6bc-4277-93ef-201f2ffaa6fc tempest-VolumesGetTest-1528360743 None] Lock "cinder-da02527e-f995-42c0-b044-5de956bc852f-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Lock "cinder-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d62cd1-81a3-4924-b1f4-39b9f134bc31]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Flow 'volume_create_manager' (ee3743db-20db-40f1-a02b-892e3d03806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05990848-090a-48d0-88cb-6ffe279a27ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05990848-090a-48d0-88cb-6ffe279a27ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccd8a9a-5963-443f-a079-2d4ac8049fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f93af02fc54a88ac624ed8036b2a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:38Z,use_quota=True,user_id='e32e8e5f0dba4d59923fdcd9a91941e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b494cba-2c00-4f8d-80eb-e8f53adcc6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b494cba-2c00-4f8d-80eb-e8f53adcc6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8fa95f-d839-42e4-8d36-c32281f02c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8fa95f-d839-42e4-8d36-c32281f02c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ccd8a9a-5963-443f-a079-2d4ac8049fda', 'volume_name': 'volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7cc603-5cdd-4b80-863f-920de57fe3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7cc603-5cdd-4b80-863f-920de57fe3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb09178-a64a-4b12-b2a0-0f6af00697af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:38 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde Jul 08 18:25:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Volume 5ccd8a9a-5963-443f-a079-2d4ac8049fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda', 'volume_size': 1} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:38 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccd8a9a-5963-443f-a079-2d4ac8049fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f93af02fc54a88ac624ed8036b2a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:38Z,use_quota=True,user_id='e32e8e5f0dba4d59923fdcd9a91941e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Creating volume 5ccd8a9a-5963-443f-a079-2d4ac8049fda {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:38 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:38 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda 1073741824 Jul 08 18:25:38 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:39 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" returned: 0 in 0.944s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:39 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde Jul 08 18:25:39 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:39 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda 1073741824" returned: 0 in 1.006s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:39 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda Jul 08 18:25:39 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:39 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" returned: 0 in 0.734s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde" released by "delete_volume" :: held 1.755s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:39 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Created reservations ['71d62080-4b9e-463d-b588-5d2f3f1ee0a4', '4eab548a-9b54-45d3-95f8-5b4e61ec0cc8', '90446127-3085-4b17-8c32-ccb4397e3b83', '56a8c5d1-1ec4-45d7-8a69-bd2d356ff94d'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:40 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:40 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:40 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda" returned: 0 in 0.855s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb09178-a64a-4b12-b2a0-0f6af00697af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adeca32e-2ac3-4e6b-a690-15b0b51c43a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:40 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Volume volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda (5ccd8a9a-5963-443f-a079-2d4ac8049fda): created successfully Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adeca32e-2ac3-4e6b-a690-15b0b51c43a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Flow 'volume_create_manager' (ee3743db-20db-40f1-a02b-892e3d03806c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-11a684a9-be61-415e-aa7e-2e2845924649 tempest-VolumesListAdminTestJSON-1289507135 None] Created volume successfully. Jul 08 18:25:40 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.860s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Deleted volume successfully. Jul 08 18:25:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0359953c-45f6-4006-bf73-bac7ffd52ae5 tempest-VolumesGetTest-1528360743 None] Lock "cinder-4ea21cb8-4e6c-4bba-ace0-a9b7ed24adde-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (b5e22c33-08de-4e8e-b8ee-e70f32eaecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c15529-ee9b-46ed-b4f2-85f944d0acc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c15529-ee9b-46ed-b4f2-85f944d0acc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-53355581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c3a788-2d11-4b55-97c1-052d76fd5975,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:41Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57650b6f-cef2-4402-a062-8ea76c99e1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57650b6f-cef2-4402-a062-8ea76c99e1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85a4f3-d7d8-41af-a591-144bf5af9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Acquiring lock "cinder-5ccd8a9a-5963-443f-a079-2d4ac8049fda-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Lock "cinder-5ccd8a9a-5963-443f-a079-2d4ac8049fda-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Acquiring lock "cinder-quobyte-5ccd8a9a-5963-443f-a079-2d4ac8049fda" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Lock "cinder-quobyte-5ccd8a9a-5963-443f-a079-2d4ac8049fda" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae0c769-fb1a-47da-8e71-ddcbbc26fa68]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "cinder-c30b4f66-a71d-48e6-9474-d2b7b54bc41c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-c30b4f66-a71d-48e6-9474-d2b7b54bc41c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:42 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda Jul 08 18:25:42 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "cinder-quobyte-c30b4f66-a71d-48e6-9474-d2b7b54bc41c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85a4f3-d7d8-41af-a591-144bf5af9559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98c3a788-2d11-4b55-97c1-052d76fd5975', 'volume_name': 'volume-98c3a788-2d11-4b55-97c1-052d76fd5975', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6d1a1e-92e6-4f90-8c3a-6db64efba29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6d1a1e-92e6-4f90-8c3a-6db64efba29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470e8673-5ce0-44b1-bee9-e9497d66ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:42 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Volume 98c3a788-2d11-4b55-97c1-052d76fd5975: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98c3a788-2d11-4b55-97c1-052d76fd5975', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Trying to clone 98c3a788-2d11-4b55-97c1-052d76fd5975 from image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-quobyte-c30b4f66-a71d-48e6-9474-d2b7b54bc41c" acquired by "delete_volume" :: waited 0.089s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aa20e6-0563-4c7a-a15e-91e8006951d4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:42 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c Jul 08 18:25:42 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:42 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:25:42 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:25:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[deacf0f5-e2c7-4bed-9a9e-73e539ac86e2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:43 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD Jul 08 18:25:43 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:43 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda" returned: 0 in 1.797s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:43 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda Jul 08 18:25:43 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:44 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c" returned: 0 in 1.763s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:44 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c Jul 08 18:25:44 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:44 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD" returned: 0 in 1.463s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Temporary image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 is fetched for user 1bbce50501c240718ec1a845963222b8. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:25:44 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5ccd8a9a-5963-443f-a079-2d4ac8049fda" returned: 0 in 0.941s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a750f0-aed0-4019-91e9-b27c64c41fe1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Lock "cinder-quobyte-5ccd8a9a-5963-443f-a079-2d4ac8049fda" released by "delete_volume" :: held 2.833s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:44 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD Jul 08 18:25:44 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Created reservations ['693f1599-f5a4-44d1-adcd-f6a6d451dd7c', '0ed54263-a305-4952-b8f7-5fac7f09b4d8', '5c05f8bd-0817-4ff6-8427-d6f7437b832b', 'a5872438-cfd1-473a-8129-bc45ce1a1729'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:45 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:45 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:45 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c30b4f66-a71d-48e6-9474-d2b7b54bc41c" returned: 0 in 1.248s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-quobyte-c30b4f66-a71d-48e6-9474-d2b7b54bc41c" released by "delete_volume" :: held 3.093s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Created reservations ['8f67c17b-9865-490c-ab22-a21491ade294', 'bfe0bc8a-1dd4-483f-b22a-4ab19748cc79', '3c5b436d-6a77-4eda-b64f-5c27fc5930a4', 'dcbeccaa-ce8d-4c9e-84ef-47d35fb0e49e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:45 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:45 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:45 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.888s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Deleted volume successfully. Jul 08 18:25:45 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD" returned: 0 in 1.219s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-53355581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c3a788-2d11-4b55-97c1-052d76fd5975,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:41Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Creating volume 98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:45 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-880ff692-bea7-46d6-a3b1-1badd067c6ff tempest-VolumesListAdminTestJSON-1289507135 None] Lock "cinder-5ccd8a9a-5963-443f-a079-2d4ac8049fda-delete_volume" released by "delete_volume" :: held 4.206s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:45 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 1073741824 Jul 08 18:25:45 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:46 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.826s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Deleted volume successfully. Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80f04c82-9d97-4e08-9dd7-03f6803ea650 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-c30b4f66-a71d-48e6-9474-d2b7b54bc41c-delete_volume" released by "delete_volume" :: held 4.369s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "cinder-b599c4d8-93d3-4d76-a735-93e1ca95ab11-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-b599c4d8-93d3-4d76-a735-93e1ca95ab11-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "cinder-quobyte-b599c4d8-93d3-4d76-a735-93e1ca95ab11" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-quobyte-b599c4d8-93d3-4d76-a735-93e1ca95ab11" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c929e4c0-0999-483e-8b2c-52e9229dec53]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:46 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 Jul 08 18:25:46 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:47 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 1073741824" returned: 0 in 1.204s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:47 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 Jul 08 18:25:47 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (a675385d-a82d-447c-b7a7-e23039083160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946e6218-d4fc-4955-8e35-03ac93852529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946e6218-d4fc-4955-8e35-03ac93852529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1762716173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627d7f05-e56d-4f65-a1cf-f29d0f0ea996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:47Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9413cf-b3b5-442d-8b6c-9d060436e89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9413cf-b3b5-442d-8b6c-9d060436e89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34de6270-835d-4ead-a80d-8c6059e2dd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34de6270-835d-4ead-a80d-8c6059e2dd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627d7f05-e56d-4f65-a1cf-f29d0f0ea996', 'volume_name': 'volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9210a5dd-a27e-4436-aa71-e93e129f8b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9210a5dd-a27e-4436-aa71-e93e129f8b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c5c55d-bc8c-4d96-bf38-0d7ef2762d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Volume 627d7f05-e56d-4f65-a1cf-f29d0f0ea996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996', 'volume_size': 1} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:47 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11" returned: 0 in 0.873s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:47 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11 Jul 08 18:25:47 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (ab48be9c-09f3-468f-a602-3c56e5731d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fcb5166-ee98-4c54-92cc-25f4414d14ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fcb5166-ee98-4c54-92cc-25f4414d14ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466656831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32902bb9-0105-41c9-b387-57a2ef1ea9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:48Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9beb4b3-cd8e-4fee-a5af-0b9b6ee96705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9beb4b3-cd8e-4fee-a5af-0b9b6ee96705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f5c600-0b13-442f-9076-a0c9039d611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f5c600-0b13-442f-9076-a0c9039d611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32902bb9-0105-41c9-b387-57a2ef1ea9e3', 'volume_name': 'volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6150cf-af9e-4772-aa9a-6d3f2512a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6150cf-af9e-4772-aa9a-6d3f2512a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cdca8d-2353-4067-8cde-47f30f41d7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:47 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Volume 32902bb9-0105-41c9-b387-57a2ef1ea9e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3', 'volume_size': 1} Jul 08 18:25:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:48 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975" returned: 0 in 1.042s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1762716173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627d7f05-e56d-4f65-a1cf-f29d0f0ea996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:47Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Creating volume 627d7f05-e56d-4f65-a1cf-f29d0f0ea996 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:48 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:48 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 1073741824 Jul 08 18:25:48 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Attempting download of 2c4a33de-7646-4da0-8ea3-4caf9de5a137 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}])) to volume 98c3a788-2d11-4b55-97c1-052d76fd5975. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c10bd-c2e4-48ba-989d-76d62976b31b]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_rs_9snd3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:48 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_rs_9snd3 Jul 08 18:25:48 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (a7877379-4952-4bbb-991c-b8e0a2e8f268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cf616a-16ab-4d03-aa7c-0519445a31fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cf616a-16ab-4d03-aa7c-0519445a31fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-490924327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0021ad-a4e2-4086-9aa4-20d1d45c11c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:49Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:49 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ea9f74-5dc8-4367-b21c-89726c8c7056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ea9f74-5dc8-4367-b21c-89726c8c7056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6b0c02-e60a-4ab6-984b-9cb81b74aadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6b0c02-e60a-4ab6-984b-9cb81b74aadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0021ad-a4e2-4086-9aa4-20d1d45c11c7', 'volume_name': 'volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d5fd3b-d142-4103-8cd2-6bc7675467d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d5fd3b-d142-4103-8cd2-6bc7675467d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fb89dd-1a3a-47b1-b216-54850dcb11f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Volume ce0021ad-a4e2-4086-9aa4-20d1d45c11c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7', 'volume_size': 1} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b599c4d8-93d3-4d76-a735-93e1ca95ab11" returned: 0 in 1.475s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-quobyte-b599c4d8-93d3-4d76-a735-93e1ca95ab11" released by "delete_volume" :: held 2.425s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Created reservations ['79fe8bf2-b1de-4056-816f-f88fb49293ed', '4c060b63-6c7b-4f23-adb0-ffb3181e491f', 'a0720c0f-a4d1-4081-8a7b-b076e285044e', '03362d2f-e6f9-47e0-a413-1529ddc0399c'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:49 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:49 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (9d2acc33-d733-4159-84b0-a6d59005ba92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63fa1a06-1519-4f42-ba72-61f5964bb005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63fa1a06-1519-4f42-ba72-61f5964bb005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386256257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361fa4d1-28f1-430b-a96a-eedee0b2816c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:50Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f368bba7-6311-434d-83d7-8dce28831989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f368bba7-6311-434d-83d7-8dce28831989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472df0ac-2b3d-433a-b34d-9c90efce5c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472df0ac-2b3d-433a-b34d-9c90efce5c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361fa4d1-28f1-430b-a96a-eedee0b2816c', 'volume_name': 'volume-361fa4d1-28f1-430b-a96a-eedee0b2816c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24769bb-aff1-4552-80c1-27c1cd212b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24769bb-aff1-4552-80c1-27c1cd212b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924c01b3-c31d-44c0-9124-238bf077972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:49 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Volume 361fa4d1-28f1-430b-a96a-eedee0b2816c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361fa4d1-28f1-430b-a96a-eedee0b2816c', 'volume_size': 1} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:49 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_rs_9snd3" returned: 0 in 1.564s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_rs_9snd3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:50 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 1073741824" returned: 0 in 1.963s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:50 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_rs_9snd3 Jul 08 18:25:50 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:50 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 Jul 08 18:25:50 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "cinder-d65afc7f-ce8a-4717-8f29-a703e28839ee-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-d65afc7f-ce8a-4717-8f29-a703e28839ee-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (351c053c-b33b-445a-bd62-4534dd807822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69767493-75df-452b-b428-94ce00f21807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "cinder-quobyte-d65afc7f-ce8a-4717-8f29-a703e28839ee" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69767493-75df-452b-b428-94ce00f21807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-518707628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:50Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad2ba5a-a9af-48ef-984e-68e1e1b3b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad2ba5a-a9af-48ef-984e-68e1e1b3b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5551c2-afb4-43a3-8f6d-1e54b3bf5e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5551c2-afb4-43a3-8f6d-1e54b3bf5e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7', 'volume_name': 'volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1494749-426e-4163-89dd-4bddee97850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1494749-426e-4163-89dd-4bddee97850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fcd26f-1c3e-48d0-9aba-2fa7f2e5ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Volume 9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7', 'volume_size': 1} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-quobyte-d65afc7f-ce8a-4717-8f29-a703e28839ee" acquired by "delete_volume" :: waited 0.070s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece18fc-fce8-42d7-831b-4d786569a7f4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:50 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.367s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Deleted volume successfully. Jul 08 18:25:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ab4126f1-9d6c-43df-97d6-0e1c079ca630 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-b599c4d8-93d3-4d76-a735-93e1ca95ab11-delete_volume" released by "delete_volume" :: held 4.242s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:50 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee Jul 08 18:25:50 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:51 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_rs_9snd3" returned: 1 in 1.156s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_rs_9snd3' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdda70fb-75d1-477a-8fee-e2180511a566]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:51 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996" returned: 0 in 0.924s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] <== create_volume: return (2984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.990s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.196s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466656831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32902bb9-0105-41c9-b387-57a2ef1ea9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:48Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Creating volume 32902bb9-0105-41c9-b387-57a2ef1ea9e3 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:51 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c5c55d-bc8c-4d96-bf38-0d7ef2762d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb42bbb0-f84b-431a-aa5e-839ac3800928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:51 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 1073741824 Jul 08 18:25:51 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:51 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Volume volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 (627d7f05-e56d-4f65-a1cf-f29d0f0ea996): created successfully Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb42bbb0-f84b-431a-aa5e-839ac3800928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (a675385d-a82d-447c-b7a7-e23039083160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-190d3b18-ab58-4c7e-8567-c14da73e3fc1 tempest-CreateVolumesFromImageTest-443283126 None] Created volume successfully. Jul 08 18:25:51 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD Jul 08 18:25:51 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:52 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD" returned: 0 in 0.987s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:52 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] 2c4a33de-7646-4da0-8ea3-4caf9de5a137 was qcow2, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:25:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:52 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee" returned: 0 in 1.471s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:52 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 Jul 08 18:25:52 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:52 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee Jul 08 18:25:52 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:52 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 1073741824" returned: 0 in 1.404s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:52 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 Jul 08 18:25:52 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:53 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-d65afc7f-ce8a-4717-8f29-a703e28839ee" returned: 0 in 0.940s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-quobyte-d65afc7f-ce8a-4717-8f29-a703e28839ee" released by "delete_volume" :: held 2.472s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Created reservations ['df5f8cc9-9142-468d-8f9a-44e2a02bc099', '60bc15ca-3366-4063-a5f6-a41b350db609', 'aa322289-a214-4a01-acbb-d46411ae37f2', '220827a5-e551-4792-a843-a95b83c45ec3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:53 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:25:53 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:53 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3" returned: 0 in 0.828s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.339s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-490924327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0021ad-a4e2-4086-9aa4-20d1d45c11c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:49Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Creating volume ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:53 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9cdca8d-2353-4067-8cde-47f30f41d7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:53 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 1073741824 Jul 08 18:25:53 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926c5e64-4aa5-4e86-aeb6-05321dfd1abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:53 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Volume volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 (32902bb9-0105-41c9-b387-57a2ef1ea9e3): created successfully Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926c5e64-4aa5-4e86-aeb6-05321dfd1abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (ab48be9c-09f3-468f-a602-3c56e5731d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:53 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ee6873d7-969d-457a-9763-a46adf12d248 tempest-CreateVolumesFromImageTest-443283126 None] Created volume successfully. Jul 08 18:25:54 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.434s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:54 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:25:54 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Deleted volume successfully. Jul 08 18:25:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1005d48a-6a7c-4af8-840a-e1459cbb37a0 tempest-VolumesListAdminTestJSON-651026052 None] Lock "cinder-d65afc7f-ce8a-4717-8f29-a703e28839ee-delete_volume" released by "delete_volume" :: held 4.433s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:25:55 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975" returned: 0 in 3.088s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_m80laaakdevstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:25:55 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Converted 112.00 MB image at 36.26 MB/s Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:55 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 1G Jul 08 18:25:55 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:55 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 1073741824" returned: 0 in 1.792s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:55 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 Jul 08 18:25:55 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Flow 'volume_create_manager' (25614c72-b616-4859-93b2-5202ab83c5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23340aa1-f458-4c5c-b4d9-2f1c4b9e5cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23340aa1-f458-4c5c-b4d9-2f1c4b9e5cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-301641388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7db880-875c-4640-95df-0567ecf6edda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6312899b38494b7eb48842272d2a332c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:56Z,use_quota=True,user_id='d4ccbe6d98314ed98172ea3fdca7eaf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e688597-a4a5-4e85-8c30-53759e4114cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e688597-a4a5-4e85-8c30-53759e4114cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582716b3-bf6a-4b0b-b3dd-3ae86b61d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582716b3-bf6a-4b0b-b3dd-3ae86b61d79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7db880-875c-4640-95df-0567ecf6edda', 'volume_name': 'volume-8c7db880-875c-4640-95df-0567ecf6edda', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def15dec-af98-4893-939e-fc6afe171bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def15dec-af98-4893-939e-fc6afe171bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12820be8-31a6-4bde-804e-a3d45c79ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:55 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Volume 8c7db880-875c-4640-95df-0567ecf6edda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7db880-875c-4640-95df-0567ecf6edda', 'volume_size': 1} Jul 08 18:25:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:56 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 1G" returned: 0 in 1.268s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759f6af-83b3-4d3f-b105-90d8dcf3a74b]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:56 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7" returned: 0 in 1.254s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] <== create_volume: return (3102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.111s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.779s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386256257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361fa4d1-28f1-430b-a96a-eedee0b2816c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:50Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Creating volume 361fa4d1-28f1-430b-a96a-eedee0b2816c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:56 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fb89dd-1a3a-47b1-b216-54850dcb11f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4090f723-f637-452f-b820-b71a4125f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:56 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c 1073741824 Jul 08 18:25:56 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:56 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Volume volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 (ce0021ad-a4e2-4086-9aa4-20d1d45c11c7): created successfully Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4090f723-f637-452f-b820-b71a4125f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:56 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 Jul 08 18:25:56 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (a7877379-4952-4bbb-991c-b8e0a2e8f268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-583b454a-002d-43b9-b465-7b02b6a84f2e tempest-CreateVolumesFromImageTest-443283126 None] Created volume successfully. Jul 08 18:25:57 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975" returned: 0 in 1.203s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:58 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 Jul 08 18:25:58 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:58 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c 1073741824" returned: 0 in 1.471s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:58 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c Jul 08 18:25:58 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:59 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975" returned: 1 in 1.408s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Downloaded image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}])) to volume 98c3a788-2d11-4b55-97c1-052d76fd5975 successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Temporary image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 for user 1bbce50501c240718ec1a845963222b8 is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Marking volume 98c3a788-2d11-4b55-97c1-052d76fd5975 as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Copying metadata from image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 to 98c3a788-2d11-4b55-97c1-052d76fd5975. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Creating volume glance metadata for volume 98c3a788-2d11-4b55-97c1-052d76fd5975 backed by image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470e8673-5ce0-44b1-bee9-e9497d66ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c3a788-2d11-4b55-97c1-052d76fd5975', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:59 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f13d8f9-8b41-458f-9723-714b3321fe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c" returned: 0 in 1.209s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] <== create_volume: return (2767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.770s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.744s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-518707628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c34ad5fc64c404ebd05a0d8366eb69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:50Z,use_quota=True,user_id='cdd7c81104564dd0a66c39303eb17740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Creating volume 9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:25:59 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:25:59 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Volume volume-98c3a788-2d11-4b55-97c1-052d76fd5975 (98c3a788-2d11-4b55-97c1-052d76fd5975): created successfully Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f13d8f9-8b41-458f-9723-714b3321fe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:59 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 1073741824 Jul 08 18:25:59 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (b5e22c33-08de-4e8e-b8ee-e70f32eaecbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9b1c3e45-1d94-466f-b115-7e19e2f9776d tempest-VolumesGetTest-1528360743 None] Created volume successfully. Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924c01b3-c31d-44c0-9124-238bf077972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361fa4d1-28f1-430b-a96a-eedee0b2816c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3bfcc4-539c-4e4a-b739-4c6dbd27f00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:25:59 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Volume volume-361fa4d1-28f1-430b-a96a-eedee0b2816c (361fa4d1-28f1-430b-a96a-eedee0b2816c): created successfully Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3bfcc4-539c-4e4a-b739-4c6dbd27f00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:25:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (9d2acc33-d733-4159-84b0-a6d59005ba92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:25:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a46b730f-4fca-41ce-b0a2-b10c78d128ab tempest-CreateVolumesFromImageTest-443283126 None] Created volume successfully. Jul 08 18:26:00 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 1073741824" returned: 0 in 1.076s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:00 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 Jul 08 18:26:00 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:01 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7" returned: 0 in 1.058s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.682s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-301641388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7db880-875c-4640-95df-0567ecf6edda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6312899b38494b7eb48842272d2a332c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:25:56Z,use_quota=True,user_id='d4ccbe6d98314ed98172ea3fdca7eaf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Creating volume 8c7db880-875c-4640-95df-0567ecf6edda {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:01 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:01 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda 1073741824 Jul 08 18:26:01 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fcd26f-1c3e-48d0-9aba-2fa7f2e5ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba665121-2386-4908-90ed-e47e6cc32e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:01 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Volume volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 (9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7): created successfully Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba665121-2386-4908-90ed-e47e6cc32e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Flow 'volume_create_manager' (351c053c-b33b-445a-bd62-4534dd807822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (89a9d3b0-38e5-403d-976e-879b0e80c6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7837be58-5894-408a-8436-d9680aa03b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-11e0087e-4203-4491-b363-21d6de2d2a04 tempest-CreateVolumesFromImageTest-443283126 None] Created volume successfully. Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7837be58-5894-408a-8436-d9680aa03b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1989198449',display_name='tempest-VolumesGetTest-Volume-1432939847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713e3525-a40c-432b-a3b2-f5d2699499d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:02Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0ec59d-dc71-430a-a7f3-45df8d0d8461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0ec59d-dc71-430a-a7f3-45df8d0d8461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ab07ac-ece1-40c2-b5bc-b1337cc872bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ab07ac-ece1-40c2-b5bc-b1337cc872bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713e3525-a40c-432b-a3b2-f5d2699499d7', 'volume_name': 'volume-713e3525-a40c-432b-a3b2-f5d2699499d7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146c6be-bfb2-42a0-ac2a-380ea020e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146c6be-bfb2-42a0-ac2a-380ea020e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecc0e27-73c0-46ef-b3b8-799d81b761a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:01 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Volume 713e3525-a40c-432b-a3b2-f5d2699499d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713e3525-a40c-432b-a3b2-f5d2699499d7', 'volume_size': 1} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-quobyte-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da833f-112a-43b6-9c42-e59c78689dd2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:02 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 Jul 08 18:26:02 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:02 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:02 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:03 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda 1073741824" returned: 0 in 1.582s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:03 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda Jul 08 18:26:03 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:03 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7" returned: 0 in 1.347s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:03 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7 Jul 08 18:26:03 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:03 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.221s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:26:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:26:04 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda" returned: 0 in 0.923s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] <== create_volume: return (2583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.587s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.306s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1989198449',display_name='tempest-VolumesGetTest-Volume-1432939847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713e3525-a40c-432b-a3b2-f5d2699499d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f66389fe83643a1b4f53e2064741597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:02Z,use_quota=True,user_id='1bbce50501c240718ec1a845963222b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Creating volume 713e3525-a40c-432b-a3b2-f5d2699499d7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:04 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12820be8-31a6-4bde-804e-a3d45c79ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7db880-875c-4640-95df-0567ecf6edda', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:04 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 1073741824 Jul 08 18:26:04 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe951b1-cb5d-47e3-ae5e-880c27057b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:04 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Volume volume-8c7db880-875c-4640-95df-0567ecf6edda (8c7db880-875c-4640-95df-0567ecf6edda): created successfully Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe951b1-cb5d-47e3-ae5e-880c27057b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Flow 'volume_create_manager' (25614c72-b616-4859-93b2-5202ab83c5b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:04 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7" returned: 0 in 0.787s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-62272840-066c-4ddc-bf2f-cee604bced1e tempest-TestMinimumBasicScenario-1691688240 None] Created volume successfully. Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7" released by "delete_volume" :: held 2.203s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Created reservations ['04a6820e-7adc-4004-a78d-d91e1704b58f', 'ac58ab08-9fe7-453e-9625-ae39d6f4ef8f', '3c58a41b-1865-4dad-8b75-113128610407', '716f2913-59a6-4bb4-a8a3-1308cc7fcfce'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:04 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:04 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Flow 'volume_create_manager' (096050e8-0c26-4569-816a-c26b229442a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16db3e1-b328-4f53-903e-ef3a9eb9336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16db3e1-b328-4f53-903e-ef3a9eb9336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-45021939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c283f86e-b512-43ba-9594-c69efc55965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b392443c6ee488ba5c46d1a5fa3369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:05Z,use_quota=True,user_id='92eba47010ea4f68ae9106c9384c3ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b1449f-3340-41d4-b63f-c8f8ee14140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b1449f-3340-41d4-b63f-c8f8ee14140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328e9eec-7cfd-45eb-8420-6d8b67ce16b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328e9eec-7cfd-45eb-8420-6d8b67ce16b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c283f86e-b512-43ba-9594-c69efc55965f', 'volume_name': 'volume-c283f86e-b512-43ba-9594-c69efc55965f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bff3d96-e09e-4577-a628-72bde4dc615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bff3d96-e09e-4577-a628-72bde4dc615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c187f1a7-5d71-4164-9524-edb41abe4da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Volume c283f86e-b512-43ba-9594-c69efc55965f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c283f86e-b512-43ba-9594-c69efc55965f', 'volume_size': 1} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:05 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 1073741824" returned: 0 in 1.031s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:05 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 Jul 08 18:26:05 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:05 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.937s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:05 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Deleted volume successfully. Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-98c2dee5-c909-4960-8a11-fbcd5f4fb72a tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-9cbf44e8-0764-462a-aeff-9dd7f0e1d6c7-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-361fa4d1-28f1-430b-a96a-eedee0b2816c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-361fa4d1-28f1-430b-a96a-eedee0b2816c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-quobyte-361fa4d1-28f1-430b-a96a-eedee0b2816c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-361fa4d1-28f1-430b-a96a-eedee0b2816c" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4845b-2ba5-4d8b-b1d9-457ccde40bf1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:05 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c Jul 08 18:26:05 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:05 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7" returned: 0 in 0.663s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.783s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-45021939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c283f86e-b512-43ba-9594-c69efc55965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b392443c6ee488ba5c46d1a5fa3369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:05Z,use_quota=True,user_id='92eba47010ea4f68ae9106c9384c3ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Creating volume c283f86e-b512-43ba-9594-c69efc55965f {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:05 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecc0e27-73c0-46ef-b3b8-799d81b761a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713e3525-a40c-432b-a3b2-f5d2699499d7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:05 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f 1073741824 Jul 08 18:26:05 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846c2e09-42c3-4e2d-aa9b-192d27297323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Volume volume-713e3525-a40c-432b-a3b2-f5d2699499d7 (713e3525-a40c-432b-a3b2-f5d2699499d7): created successfully Jul 08 18:26:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846c2e09-42c3-4e2d-aa9b-192d27297323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Flow 'volume_create_manager' (89a9d3b0-38e5-403d-976e-879b0e80c6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-cafcd00f-cc09-4427-b6a9-28a381729b1d tempest-VolumesGetTest-1528360743 None] Created volume successfully. Jul 08 18:26:06 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c" returned: 0 in 0.805s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:06 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c Jul 08 18:26:06 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:06 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f 1073741824" returned: 0 in 0.897s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:06 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f Jul 08 18:26:06 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:07 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-713e3525-a40c-432b-a3b2-f5d2699499d7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-361fa4d1-28f1-430b-a96a-eedee0b2816c" returned: 0 in 0.789s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Lock "cinder-713e3525-a40c-432b-a3b2-f5d2699499d7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-361fa4d1-28f1-430b-a96a-eedee0b2816c" released by "delete_volume" :: held 1.646s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-713e3525-a40c-432b-a3b2-f5d2699499d7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Created reservations ['fd9efbec-3417-4b1f-843f-d2a00a71f380', 'd4a510ec-d31f-4ec8-b5d8-f4d8901658f9', '616d119f-e75f-4e0a-8a7b-898f9e58c16e', '0687bda7-bfdc-4b78-912c-bcfdc9f50f91'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-713e3525-a40c-432b-a3b2-f5d2699499d7" acquired by "delete_volume" :: waited 0.040s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4700d0e6-5213-4878-9147-ef039ceb1582]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:07 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:07 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:07 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 Jul 08 18:26:07 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:07 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f" returned: 0 in 0.775s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c187f1a7-5d71-4164-9524-edb41abe4da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c283f86e-b512-43ba-9594-c69efc55965f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098a2b38-eecf-457c-a7b1-e733b1bde60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:07 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Volume volume-c283f86e-b512-43ba-9594-c69efc55965f (c283f86e-b512-43ba-9594-c69efc55965f): created successfully Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098a2b38-eecf-457c-a7b1-e733b1bde60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Flow 'volume_create_manager' (096050e8-0c26-4569-816a-c26b229442a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:07 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e36c1aaa-b95f-4d29-86c8-fc3efa4489bb tempest-VolumesMetadataTest-2091156910 None] Created volume successfully. Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-quobyte-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c96e16-c11e-402d-ad16-68ee8e77e635]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-f959430a-5771-43fb-86a6-8a3df267e941 req-847076e0-4d4a-4422-b629-137d808e39f6 tempest-TestMinimumBasicScenario-1691688240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-f959430a-5771-43fb-86a6-8a3df267e941 req-847076e0-4d4a-4422-b629-137d808e39f6 tempest-TestMinimumBasicScenario-1691688240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958f83a-add9-4e87-a4c1-bebadb752f05]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-f959430a-5771-43fb-86a6-8a3df267e941 req-847076e0-4d4a-4422-b629-137d808e39f6 tempest-TestMinimumBasicScenario-1691688240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:08 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 Jul 08 18:26:08 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:08 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7" returned: 0 in 1.047s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:08 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.017s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:08 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Deleted volume successfully. Jul 08 18:26:08 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7 Jul 08 18:26:08 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:08 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda Jul 08 18:26:08 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-74af2722-dc97-4f6a-a0f4-38734173e422 tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-361fa4d1-28f1-430b-a96a-eedee0b2816c-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:09 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7" returned: 0 in 1.081s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:09 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7 Jul 08 18:26:09 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:09 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Acquiring lock "cinder-c283f86e-b512-43ba-9594-c69efc55965f-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-f959430a-5771-43fb-86a6-8a3df267e941 req-847076e0-4d4a-4422-b629-137d808e39f6 tempest-TestMinimumBasicScenario-1691688240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda" returned: 0 in 1.076s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-f959430a-5771-43fb-86a6-8a3df267e941 req-847076e0-4d4a-4422-b629-137d808e39f6 tempest-TestMinimumBasicScenario-1691688240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.112s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Lock "cinder-c283f86e-b512-43ba-9594-c69efc55965f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:09 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-713e3525-a40c-432b-a3b2-f5d2699499d7" returned: 0 in 0.960s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Acquiring lock "cinder-quobyte-c283f86e-b512-43ba-9594-c69efc55965f" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-713e3525-a40c-432b-a3b2-f5d2699499d7" released by "delete_volume" :: held 2.069s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-f959430a-5771-43fb-86a6-8a3df267e941 req-847076e0-4d4a-4422-b629-137d808e39f6 tempest-TestMinimumBasicScenario-1691688240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-8c7db880-875c-4640-95df-0567ecf6edda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d8b0046-668f-4048-8653-a4f693b6fff3', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Lock "cinder-quobyte-c283f86e-b512-43ba-9594-c69efc55965f" acquired by "delete_volume" :: waited 0.034s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd55bba-0c48-4200-aeea-5b553d4f7ac4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-f959430a-5771-43fb-86a6-8a3df267e941 req-847076e0-4d4a-4422-b629-137d808e39f6 tempest-TestMinimumBasicScenario-1691688240 None] attachment_update completed successfully. Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Created reservations ['3e138036-9e72-4b80-b666-a71b05e9bd33', '0b4a2337-3ac1-4840-b15e-5d2382a64018', '649ff467-3ff6-41ff-b9ec-2f8bb9c9d918', 'd107d4df-4bb5-4355-ae37-1e37e05a7dcb'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:09 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f Jul 08 18:26:09 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:09 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:09 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:10 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7" returned: 0 in 0.900s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7" released by "delete_volume" :: held 2.079s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Created reservations ['5746f0d9-e2cf-459a-80fb-17788caf93a0', '1d57748a-e11d-4198-8fea-8714d7c16e3a', '99d3da31-bef9-432a-ae6c-de12763ae34b', 'fd4bcc4b-d323-40d3-bebc-b3cbfea57411'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:10 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:10 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:10 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f" returned: 0 in 0.940s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:10 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f Jul 08 18:26:10 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:10 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.888s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:10 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Deleted volume successfully. Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0b0c8307-649e-41c8-af37-0cd7e2c64577 tempest-VolumesGetTest-1528360743 None] Lock "cinder-713e3525-a40c-432b-a3b2-f5d2699499d7-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-98c3a788-2d11-4b55-97c1-052d76fd5975-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Lock "cinder-98c3a788-2d11-4b55-97c1-052d76fd5975-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Acquiring lock "cinder-quobyte-98c3a788-2d11-4b55-97c1-052d76fd5975" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-98c3a788-2d11-4b55-97c1-052d76fd5975" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13b426c-de06-49b4-badd-82107e46b5ed]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:11 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 Jul 08 18:26:11 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:11 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.019s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Deleted volume successfully. Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73d0b008-fac0-4c77-a764-d6abb05980bc tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-ce0021ad-a4e2-4086-9aa4-20d1d45c11c7-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-32902bb9-0105-41c9-b387-57a2ef1ea9e3-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:11 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c283f86e-b512-43ba-9594-c69efc55965f" returned: 0 in 0.948s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-32902bb9-0105-41c9-b387-57a2ef1ea9e3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Lock "cinder-quobyte-c283f86e-b512-43ba-9594-c69efc55965f" released by "delete_volume" :: held 1.963s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-quobyte-32902bb9-0105-41c9-b387-57a2ef1ea9e3" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-32902bb9-0105-41c9-b387-57a2ef1ea9e3" acquired by "delete_volume" :: waited 0.049s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Created reservations ['3745ee97-e84c-4fa9-9a4a-7c75dbb8090a', '1c7209af-8d2e-4108-9e90-73f0a29076c5', 'a026f60d-0b6c-400a-b54d-bd9195ee2405', '5f0fccfe-6d2c-42c2-9c4e-945873b7e699'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2360721-18a2-4eec-b18c-2cbe22e01c7d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:11 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:11 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:11 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 Jul 08 18:26:11 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:12 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975" returned: 0 in 1.079s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:12 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 Jul 08 18:26:12 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:12 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:12 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3" returned: 0 in 0.898s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.804s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:12 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Deleted volume successfully. Jul 08 18:26:12 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3 Jul 08 18:26:12 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6feff684-69b3-4087-8102-9d5840c1a497 tempest-VolumesMetadataTest-2091156910 None] Lock "cinder-c283f86e-b512-43ba-9594-c69efc55965f-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:13 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975" returned: 1 in 0.976s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:13 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975 Jul 08 18:26:13 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:13 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-32902bb9-0105-41c9-b387-57a2ef1ea9e3" returned: 0 in 0.842s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-32902bb9-0105-41c9-b387-57a2ef1ea9e3" released by "delete_volume" :: held 1.795s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Created reservations ['974f300a-ed17-4d4a-94c4-c25ebef78a3a', 'dcaa77f7-2a5f-4b07-8f34-fa305701c5a3', '05977ac2-0df4-4db8-9230-12626a74595a', 'a3e75832-7dba-43ae-974e-604887b05efe'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:13 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:13 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-627d7f05-e56d-4f65-a1cf-f29d0f0ea996-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:13 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-98c3a788-2d11-4b55-97c1-052d76fd5975" returned: 0 in 0.855s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-627d7f05-e56d-4f65-a1cf-f29d0f0ea996-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Lock "cinder-quobyte-98c3a788-2d11-4b55-97c1-052d76fd5975" released by "delete_volume" :: held 3.083s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "cinder-quobyte-627d7f05-e56d-4f65-a1cf-f29d0f0ea996" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-627d7f05-e56d-4f65-a1cf-f29d0f0ea996" acquired by "delete_volume" :: waited 0.035s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2619d7cc-2282-4869-bd25-5288282b762b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Created reservations ['5dbad676-c227-4060-8963-d65a08ff2f30', '50b652aa-5860-4349-a463-614bfc9d2891', 'cb182215-269c-48cf-a7a4-e0695aae9639', '6cf2a755-6a54-4f5d-99e0-915f69586a23'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:14 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 Jul 08 18:26:14 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:14 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:14 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:14 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.028s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Deleted volume successfully. Jul 08 18:26:14 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ede05c-9fe8-49ff-9732-d6e99ff62b59 tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-32902bb9-0105-41c9-b387-57a2ef1ea9e3-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:15 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.966s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:15 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Deleted volume successfully. Jul 08 18:26:15 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996" returned: 0 in 1.140s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cdf58725-abaa-4a28-96c4-5d5abba0ea8f tempest-VolumesGetTest-1528360743 None] Lock "cinder-98c3a788-2d11-4b55-97c1-052d76fd5975-delete_volume" released by "delete_volume" :: held 4.526s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:15 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996 Jul 08 18:26:15 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:15 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-627d7f05-e56d-4f65-a1cf-f29d0f0ea996" returned: 0 in 0.763s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-quobyte-627d7f05-e56d-4f65-a1cf-f29d0f0ea996" released by "delete_volume" :: held 1.977s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:16 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Created reservations ['e5a039e0-f3f5-4e74-a210-bea9b5476a24', '31a88bff-19a3-4854-8438-d49dfcc2f164', 'd7d3439b-ecb1-4cc1-962b-c988d7fdba99', '42d94992-6d2e-4386-89e2-255122aa5d5e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:16 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:16 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:17 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.831s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:17 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:17 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Deleted volume successfully. Jul 08 18:26:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-02a758da-162f-4393-8706-91d0261f023b tempest-CreateVolumesFromImageTest-443283126 None] Lock "cinder-627d7f05-e56d-4f65-a1cf-f29d0f0ea996-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Flow 'volume_create_manager' (ea37cb6d-7101-4525-97cf-ca1a44c71bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d46b6e8-f47d-413e-b0c4-5ab2bf142d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d46b6e8-f47d-413e-b0c4-5ab2bf142d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-416722492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff121ea-ca96-4719-9f19-91e5caa60e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd269dd1860a45cab07c81b3019cecc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:19Z,use_quota=True,user_id='843e418a6b8e471d99d2b97b8f74549c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b3ed99-6768-4800-a288-b5d363f293c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b3ed99-6768-4800-a288-b5d363f293c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6291b632-7b14-4c80-807e-9efea394f156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6291b632-7b14-4c80-807e-9efea394f156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff121ea-ca96-4719-9f19-91e5caa60e51', 'volume_name': 'volume-7ff121ea-ca96-4719-9f19-91e5caa60e51', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620bd6e0-c0f9-4a5f-adfd-fe480531d4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620bd6e0-c0f9-4a5f-adfd-fe480531d4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a6e238-b9e5-496f-9547-e9dae5e0c538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Volume 7ff121ea-ca96-4719-9f19-91e5caa60e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff121ea-ca96-4719-9f19-91e5caa60e51', 'volume_size': 1} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-416722492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff121ea-ca96-4719-9f19-91e5caa60e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd269dd1860a45cab07c81b3019cecc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:19Z,use_quota=True,user_id='843e418a6b8e471d99d2b97b8f74549c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Creating volume 7ff121ea-ca96-4719-9f19-91e5caa60e51 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:19 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:19 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 1073741824 Jul 08 18:26:19 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Flow 'volume_create_manager' (c14f793f-4f2f-4da3-b032-3ffd16ceda49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ce8511-8f89-437d-a1f8-239d7b61685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ce8511-8f89-437d-a1f8-239d7b61685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa7f62b-976e-4b13-a935-1ab87cff3507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3521937607843db8376b14947f5a216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:20Z,use_quota=True,user_id='15d0cbcfe1a74d6ea9cac6a1051494e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf290a3b-93e1-4fa7-b757-94c25c2f0a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf290a3b-93e1-4fa7-b757-94c25c2f0a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8dc598-ac2e-4849-8df1-7257cb20083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8dc598-ac2e-4849-8df1-7257cb20083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa7f62b-976e-4b13-a935-1ab87cff3507', 'volume_name': 'volume-faa7f62b-976e-4b13-a935-1ab87cff3507', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed2ab4e-c33c-4832-a3a7-3e075e06fc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed2ab4e-c33c-4832-a3a7-3e075e06fc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213cabc8-ad94-47c8-9f33-af208647f1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:19 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Volume faa7f62b-976e-4b13-a935-1ab87cff3507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa7f62b-976e-4b13-a935-1ab87cff3507', 'volume_size': 1} Jul 08 18:26:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:20 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 1073741824" returned: 0 in 1.071s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:20 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 Jul 08 18:26:20 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:21 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51" returned: 0 in 0.729s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa7f62b-976e-4b13-a935-1ab87cff3507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3521937607843db8376b14947f5a216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:20Z,use_quota=True,user_id='15d0cbcfe1a74d6ea9cac6a1051494e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Creating volume faa7f62b-976e-4b13-a935-1ab87cff3507 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:21 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:21 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 1073741824 Jul 08 18:26:21 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a6e238-b9e5-496f-9547-e9dae5e0c538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff121ea-ca96-4719-9f19-91e5caa60e51', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6161e6-21fb-41e7-8be2-044c2d504d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:21 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Volume volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 (7ff121ea-ca96-4719-9f19-91e5caa60e51): created successfully Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6161e6-21fb-41e7-8be2-044c2d504d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Flow 'volume_create_manager' (ea37cb6d-7101-4525-97cf-ca1a44c71bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:21 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-98c9d46f-67d2-42c4-9cc2-32f5ad58adec tempest-VolumesTransfersTest-1822309037 None] Created volume successfully. Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (0ab3e4cb-2274-4284-83db-560aa4a748b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2301ba7e-a75b-4904-9341-1054e08438c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2301ba7e-a75b-4904-9341-1054e08438c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99432483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1648161f-4dca-4065-bd96-7f07c54a911d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:22Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d06026-a201-428d-926d-3a84ef1f9bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d06026-a201-428d-926d-3a84ef1f9bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200d0e0e-e414-4e43-8aeb-3584d9ede8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200d0e0e-e414-4e43-8aeb-3584d9ede8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1648161f-4dca-4065-bd96-7f07c54a911d', 'volume_name': 'volume-1648161f-4dca-4065-bd96-7f07c54a911d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431ccb14-fb24-43b1-98ee-7aaa2af710ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431ccb14-fb24-43b1-98ee-7aaa2af710ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53787ec6-0c08-435e-966b-3d4e25afa832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:21 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume 1648161f-4dca-4065-bd96-7f07c54a911d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1648161f-4dca-4065-bd96-7f07c54a911d', 'volume_size': 1} Jul 08 18:26:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:22 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 1073741824" returned: 0 in 0.991s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:22 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 Jul 08 18:26:22 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:23 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507" returned: 0 in 0.797s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99432483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1648161f-4dca-4065-bd96-7f07c54a911d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:22Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Creating volume 1648161f-4dca-4065-bd96-7f07c54a911d {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:23 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213cabc8-ad94-47c8-9f33-af208647f1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa7f62b-976e-4b13-a935-1ab87cff3507', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:23 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d 1073741824 Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a04361-620c-4684-8979-8bba2bfbf4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:23 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:23 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Volume volume-faa7f62b-976e-4b13-a935-1ab87cff3507 (faa7f62b-976e-4b13-a935-1ab87cff3507): created successfully Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a04361-620c-4684-8979-8bba2bfbf4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:23 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Flow 'volume_create_manager' (c14f793f-4f2f-4da3-b032-3ffd16ceda49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-227c3623-0cd8-43cb-a260-10d13403afb8 tempest-CinderUnicodeTest-1379090199 None] Created volume successfully. Jul 08 18:26:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-40f11d47-709a-4973-8bbb-31378307232b tempest-VolumesTransfersTest-2082220370 None] Transfer volume completed successfully. Jul 08 18:26:24 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d 1073741824" returned: 0 in 0.960s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:24 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d Jul 08 18:26:24 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Acquiring lock "cinder-7ff121ea-ca96-4719-9f19-91e5caa60e51-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Lock "cinder-7ff121ea-ca96-4719-9f19-91e5caa60e51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Acquiring lock "cinder-quobyte-7ff121ea-ca96-4719-9f19-91e5caa60e51" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Lock "cinder-quobyte-7ff121ea-ca96-4719-9f19-91e5caa60e51" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac0c6d-e2bd-4a29-805b-5f219babb170]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Flow 'volume_create_manager' (a21bbd1b-fdbc-436b-be44-1a54d3ab89ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdc4c45-0f98-43cf-811b-1f6785fcdea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdc4c45-0f98-43cf-811b-1f6785fcdea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1738643812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3521937607843db8376b14947f5a216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:25Z,use_quota=True,user_id='15d0cbcfe1a74d6ea9cac6a1051494e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:24 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 Jul 08 18:26:24 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb24790-bc5c-4b08-898c-f408e5ff9971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb24790-bc5c-4b08-898c-f408e5ff9971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd89e096-4780-46ca-af5f-79e6202ce252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd89e096-4780-46ca-af5f-79e6202ce252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2', 'volume_name': 'volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa5ed2e-cd03-4ff5-a482-9e94d8759e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa5ed2e-cd03-4ff5-a482-9e94d8759e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ba1eee-1ec8-4247-be31-0ca3b88f52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:24 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Volume 7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2', 'volume_size': 1} Jul 08 18:26:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:25 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d" returned: 0 in 0.918s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1738643812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3521937607843db8376b14947f5a216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:25Z,use_quota=True,user_id='15d0cbcfe1a74d6ea9cac6a1051494e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Creating volume 7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:25 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:25 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 1073741824 Jul 08 18:26:25 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53787ec6-0c08-435e-966b-3d4e25afa832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1648161f-4dca-4065-bd96-7f07c54a911d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70532601-8e9e-4bde-ad92-82a0b650ed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:25 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume volume-1648161f-4dca-4065-bd96-7f07c54a911d (1648161f-4dca-4065-bd96-7f07c54a911d): created successfully Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70532601-8e9e-4bde-ad92-82a0b650ed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (0ab3e4cb-2274-4284-83db-560aa4a748b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:25 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a0d52adb-d12c-434f-a4f5-7d700430891b tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created volume successfully. Jul 08 18:26:25 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51" returned: 0 in 0.833s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:25 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51 Jul 08 18:26:25 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:25 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 1073741824" returned: 0 in 0.943s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:26 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 Jul 08 18:26:26 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:26 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7ff121ea-ca96-4719-9f19-91e5caa60e51" returned: 0 in 0.696s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Lock "cinder-quobyte-7ff121ea-ca96-4719-9f19-91e5caa60e51" released by "delete_volume" :: held 1.607s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Created reservations ['e4029c00-a1ee-4f88-ade2-ceb440c558c8', '5c37e2f7-bae8-471b-b463-fddfcaf97fec', 'ee771328-0171-43a4-86d3-bdbbd87ab765', 'ac19d450-6995-4716-9f71-50373415f311'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:26 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:26 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (b9c2a22b-8d72-4c94-9c0c-f5c16652b763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7714f18-f636-4b4a-a5e7-a791fc9e8e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7714f18-f636-4b4a-a5e7-a791fc9e8e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656905178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707584af-6490-471a-b1fd-37f97d69cfbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:26Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51e039d-772b-4f33-97e3-1d28fb53068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51e039d-772b-4f33-97e3-1d28fb53068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b617a93d-7b2a-4c01-b722-835b9e76e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b617a93d-7b2a-4c01-b722-835b9e76e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707584af-6490-471a-b1fd-37f97d69cfbe', 'volume_name': 'volume-707584af-6490-471a-b1fd-37f97d69cfbe', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f459d4b-f150-4edc-90b2-109e60d358bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f459d4b-f150-4edc-90b2-109e60d358bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbcb4d1-ce05-42b8-b7b7-18b9dec890d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:26 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume 707584af-6490-471a-b1fd-37f97d69cfbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707584af-6490-471a-b1fd-37f97d69cfbe', 'volume_size': 1} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:26 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" returned: 0 in 0.772s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656905178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707584af-6490-471a-b1fd-37f97d69cfbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:26Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Creating volume 707584af-6490-471a-b1fd-37f97d69cfbe {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:26 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:26 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe 1073741824 Jul 08 18:26:26 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ba1eee-1ec8-4247-be31-0ca3b88f52cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdf34e4-5944-4c42-80db-b1eb42041e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:26 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (b8ab6029-ac6b-49b3-91cf-f3d054b883d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed2992f-c51b-444f-a3cc-56790db6b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Volume volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 (7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2): created successfully Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdf34e4-5944-4c42-80db-b1eb42041e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Flow 'volume_create_manager' (a21bbd1b-fdbc-436b-be44-1a54d3ab89ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed2992f-c51b-444f-a3cc-56790db6b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762438244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05564a0c-1d8b-47c5-908b-313ee11680d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:27Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b8bb8e-5922-496e-91e2-69347f25d270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b8bb8e-5922-496e-91e2-69347f25d270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e76db61-3c07-467a-a11a-4ea52e9fa400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e76db61-3c07-467a-a11a-4ea52e9fa400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05564a0c-1d8b-47c5-908b-313ee11680d5', 'volume_name': 'volume-05564a0c-1d8b-47c5-908b-313ee11680d5', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20061d1-b60d-4faf-9fc3-81d57d0af19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20061d1-b60d-4faf-9fc3-81d57d0af19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bac0ad-7a68-4a4b-98b3-ce1e02f6ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume 05564a0c-1d8b-47c5-908b-313ee11680d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05564a0c-1d8b-47c5-908b-313ee11680d5', 'volume_size': 1} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:27 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f1248ee3-d26a-4df9-b2b9-e6730f65a8b1 tempest-CinderUnicodeTest-1379090199 None] Created volume successfully. Jul 08 18:26:27 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.990s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:27 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Deleted volume successfully. Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-973150c4-a3e1-4e08-8091-36339ab9d5a4 tempest-VolumesTransfersTest-834632821 None] Lock "cinder-7ff121ea-ca96-4719-9f19-91e5caa60e51-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Flow 'volume_create_manager' (8088787b-2803-48b4-bbf0-61083a962ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b2db8-8c71-40d9-bf84-750fff3d2f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b2db8-8c71-40d9-bf84-750fff3d2f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1364768107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dabb8c6-343b-4a9c-b2d0-a917938ded7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd269dd1860a45cab07c81b3019cecc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:28Z,use_quota=True,user_id='843e418a6b8e471d99d2b97b8f74549c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4613859-f3e7-44b6-b5e4-dbe8738762c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4613859-f3e7-44b6-b5e4-dbe8738762c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e01950-8161-425f-8414-e45c07a701d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e01950-8161-425f-8414-e45c07a701d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dabb8c6-343b-4a9c-b2d0-a917938ded7a', 'volume_name': 'volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daa1fbe-d30c-40c2-aea0-a06871413b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daa1fbe-d30c-40c2-aea0-a06871413b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518c336d-e4d0-4b58-a313-303012377ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:27 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Volume 2dabb8c6-343b-4a9c-b2d0-a917938ded7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a', 'volume_size': 1} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:27 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (62d0a376-6034-4d1f-bbfe-46468d4d4221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1227f587-6fea-4768-bc89-42f7061e19ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1227f587-6fea-4768-bc89-42f7061e19ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314081064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5871bf5d-efe7-4c1f-885a-edc7aa868146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:28Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01534107-c173-4884-80bb-d2e9096e40c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01534107-c173-4884-80bb-d2e9096e40c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f75628-c909-4301-b8a1-484a70051b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f75628-c909-4301-b8a1-484a70051b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5871bf5d-efe7-4c1f-885a-edc7aa868146', 'volume_name': 'volume-5871bf5d-efe7-4c1f-885a-edc7aa868146', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cda325e-fbd0-4ed8-a81c-d8bdfd08d92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cda325e-fbd0-4ed8-a81c-d8bdfd08d92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa7fce2-0b93-4748-997b-413af7279292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume 5871bf5d-efe7-4c1f-885a-edc7aa868146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5871bf5d-efe7-4c1f-885a-edc7aa868146', 'volume_size': 1} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:28 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (8fb3265f-ffa1-4ed6-9bb0-134e5fd2d762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bb13b9-f5d7-40bc-940a-d42f2e644f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe 1073741824" returned: 0 in 1.434s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bb13b9-f5d7-40bc-940a-d42f2e644f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902408298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973ca99a-5e8c-430f-b224-3378d1b0d5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:28Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd9818c-4bea-4a8c-bba4-db8a9c462673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd9818c-4bea-4a8c-bba4-db8a9c462673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd5a585-77bf-4e39-b900-4280414c7e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd5a585-77bf-4e39-b900-4280414c7e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '973ca99a-5e8c-430f-b224-3378d1b0d5d7', 'volume_name': 'volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526d6a98-db50-45a3-b6be-96dea80af874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526d6a98-db50-45a3-b6be-96dea80af874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284ec308-35be-4952-8e98-081451df82a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume 973ca99a-5e8c-430f-b224-3378d1b0d5d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7', 'volume_size': 1} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:28 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe Jul 08 18:26:28 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (1c601506-ce3b-4433-8020-805429ecaee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f4a1e0-b945-449f-b0cc-153d3ea646e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f4a1e0-b945-449f-b0cc-153d3ea646e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531986482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da158018-b34e-45c0-99c2-7487d0e7d3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:29Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39be8d23-e3a9-4765-a470-50beefbb0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39be8d23-e3a9-4765-a470-50beefbb0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de87d26-5856-43e0-9269-5a4f8b6dfa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de87d26-5856-43e0-9269-5a4f8b6dfa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da158018-b34e-45c0-99c2-7487d0e7d3ae', 'volume_name': 'volume-da158018-b34e-45c0-99c2-7487d0e7d3ae', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd56387-db64-4f4e-9613-9b2ae4d2da51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd56387-db64-4f4e-9613-9b2ae4d2da51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4afd104-674b-4acc-a17c-a378b56b703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:28 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume da158018-b34e-45c0-99c2-7487d0e7d3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da158018-b34e-45c0-99c2-7487d0e7d3ae', 'volume_size': 1} Jul 08 18:26:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:29 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe" returned: 0 in 0.688s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762438244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05564a0c-1d8b-47c5-908b-313ee11680d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:27Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Creating volume 05564a0c-1d8b-47c5-908b-313ee11680d5 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:29 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:29 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 1073741824 Jul 08 18:26:29 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbcb4d1-ce05-42b8-b7b7-18b9dec890d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707584af-6490-471a-b1fd-37f97d69cfbe', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292bb4e4-6dea-4bf2-b31b-526f123346aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:29 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume volume-707584af-6490-471a-b1fd-37f97d69cfbe (707584af-6490-471a-b1fd-37f97d69cfbe): created successfully Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292bb4e4-6dea-4bf2-b31b-526f123346aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (b9c2a22b-8d72-4c94-9c0c-f5c16652b763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:29 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-460915d4-b8db-47b2-9337-7f4fb4b026e4 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created volume successfully. Jul 08 18:26:29 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 1073741824" returned: 0 in 0.834s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:30 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 Jul 08 18:26:30 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:30 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5" returned: 0 in 0.638s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.656s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1364768107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dabb8c6-343b-4a9c-b2d0-a917938ded7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd269dd1860a45cab07c81b3019cecc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:28Z,use_quota=True,user_id='843e418a6b8e471d99d2b97b8f74549c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Creating volume 2dabb8c6-343b-4a9c-b2d0-a917938ded7a {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:30 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:30 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a 1073741824 Jul 08 18:26:30 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72bac0ad-7a68-4a4b-98b3-ce1e02f6ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05564a0c-1d8b-47c5-908b-313ee11680d5', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b869a6b1-25b5-4735-b258-86cb026a4887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:30 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume volume-05564a0c-1d8b-47c5-908b-313ee11680d5 (05564a0c-1d8b-47c5-908b-313ee11680d5): created successfully Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b869a6b1-25b5-4735-b258-86cb026a4887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (b8ab6029-ac6b-49b3-91cf-f3d054b883d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:30 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-57a8b256-a024-4769-b7ec-c5b424ff7eed tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created volume successfully. Jul 08 18:26:31 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a 1073741824" returned: 0 in 0.828s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:31 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=146,cinder:INSERT=60,cinder:UPDATE=193,cinder:DELETE=15 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:26:31 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=127,cinder:UPDATE=200,cinder:DELETE=21,cinder:INSERT=39 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:26:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:31 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a Jul 08 18:26:31 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:32 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a" returned: 0 in 0.633s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.050s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314081064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5871bf5d-efe7-4c1f-885a-edc7aa868146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:28Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Creating volume 5871bf5d-efe7-4c1f-885a-edc7aa868146 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:32 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518c336d-e4d0-4b58-a313-303012377ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:32 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 1073741824 Jul 08 18:26:32 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207767dd-30fe-45f8-99a6-02b7d0c5e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:32 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Volume volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a (2dabb8c6-343b-4a9c-b2d0-a917938ded7a): created successfully Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207767dd-30fe-45f8-99a6-02b7d0c5e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:32 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Flow 'volume_create_manager' (8088787b-2803-48b4-bbf0-61083a962ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:32 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d67025ea-fa05-45b1-a8e8-78275811e8b8 tempest-VolumesTransfersTest-1822309037 None] Created volume successfully. Jul 08 18:26:33 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 1073741824" returned: 0 in 0.886s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Acquiring lock "cinder-2dabb8c6-343b-4a9c-b2d0-a917938ded7a-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:33 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 Jul 08 18:26:33 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Lock "cinder-2dabb8c6-343b-4a9c-b2d0-a917938ded7a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Acquiring lock "cinder-quobyte-2dabb8c6-343b-4a9c-b2d0-a917938ded7a" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Lock "cinder-quobyte-2dabb8c6-343b-4a9c-b2d0-a917938ded7a" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[155eb5f3-6940-400d-9eca-9e9b556f8c04]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:33 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a Jul 08 18:26:33 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:33 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146" returned: 0 in 0.671s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.356s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902408298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973ca99a-5e8c-430f-b224-3378d1b0d5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:28Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Creating volume 973ca99a-5e8c-430f-b224-3378d1b0d5d7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:33 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa7fce2-0b93-4748-997b-413af7279292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5871bf5d-efe7-4c1f-885a-edc7aa868146', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48137184-722e-46a7-bcf8-69ca064edd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:33 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 1073741824 Jul 08 18:26:33 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:33 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 (5871bf5d-efe7-4c1f-885a-edc7aa868146): created successfully Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48137184-722e-46a7-bcf8-69ca064edd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (62d0a376-6034-4d1f-bbfe-46468d4d4221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:33 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c9f66e46-0a31-4b4c-b66a-d5fbce320e8a tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created volume successfully. Jul 08 18:26:34 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a" returned: 0 in 0.835s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:34 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a Jul 08 18:26:34 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:34 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 1073741824" returned: 0 in 0.850s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:34 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 Jul 08 18:26:34 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:34 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2dabb8c6-343b-4a9c-b2d0-a917938ded7a" returned: 0 in 0.644s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Lock "cinder-quobyte-2dabb8c6-343b-4a9c-b2d0-a917938ded7a" released by "delete_volume" :: held 1.524s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Created reservations ['d5106f1c-e9b9-4a4b-9ea1-84fcb7e4f322', '4799c6ff-b964-41ab-b4b8-f11c4286abeb', '21e979ff-ec82-46b2-9361-88d0efaee194', 'dfdd0525-cdda-4e89-b494-641312f7b4ab'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:34 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:34 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:35 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7" returned: 0 in 0.666s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.919s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284ec308-35be-4952-8e98-081451df82a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10085b4-95d6-4b01-8cf8-69daff8b9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Creating offline snapshot bd8e47b2-c530-4318-8bcb-d308ac3471d7 of volume 7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:26:35 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 (973ca99a-5e8c-430f-b224-3378d1b0d5d7): created successfully Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10085b4-95d6-4b01-8cf8-69daff8b9022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (8fb3265f-ffa1-4ed6-9bb0-134e5fd2d762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[254e196e-af14-4579-963e-b27554363699]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f2214502-b0c3-442e-91e4-f96d959b7e55 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created volume successfully. Jul 08 18:26:35 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.683s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:35 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 Jul 08 18:26:35 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Deleted volume successfully. Jul 08 18:26:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6e88b02c-757e-41fb-bd71-666176fda983 tempest-VolumesTransfersTest-834632821 None] Lock "cinder-2dabb8c6-343b-4a9c-b2d0-a917938ded7a-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:36 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" returned: 0 in 0.917s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:36 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 1G Jul 08 18:26:36 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:37 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 1G" returned: 0 in 0.830s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:37 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 Jul 08 18:26:37 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:37 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:37 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 is being set with open permissions: ugo+rw Jul 08 18:26:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:37 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 Jul 08 18:26:37 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:38 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7" returned: 0 in 0.692s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:38 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.info Jul 08 18:26:38 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:39 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.info" returned: 0 in 0.707s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:39 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.info is being set with open permissions: ugo+rw Jul 08 18:26:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:39 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.info Jul 08 18:26:39 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:40 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.info" returned: 0 in 0.749s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.880s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.480s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531986482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da158018-b34e-45c0-99c2-7487d0e7d3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b76994502994db688fd2823f8fdb29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:29Z,use_quota=True,user_id='f02d4ce6adc84b3abdd6059b664e34e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Creating volume da158018-b34e-45c0-99c2-7487d0e7d3ae {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:40 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:40 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae 1073741824 Jul 08 18:26:40 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-14e6187d-3062-489f-bfa4-2c3386466e18 tempest-CinderUnicodeTest-1379090199 None] Create snapshot completed successfully Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "cinder-bd8e47b2-c530-4318-8bcb-d308ac3471d7-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-bd8e47b2-c530-4318-8bcb-d308ac3471d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "cinder-quobyte-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-quobyte-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "cinder-quobyte-bd8e47b2-c530-4318-8bcb-d308ac3471d7" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-quobyte-bd8e47b2-c530-4318-8bcb-d308ac3471d7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Deleting offline snapshot bd8e47b2-c530-4318-8bcb-d308ac3471d7 of volume 7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] snapshot_file for this snap is: volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2668149d-0ce3-4b78-8cd0-41b2cbd95215]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:41 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 Jul 08 18:26:41 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:41 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae 1073741824" returned: 0 in 1.122s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:41 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae Jul 08 18:26:41 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:42 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7" returned: 0 in 1.192s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8642b05f-63dd-4d48-bbf1-b8381d39cf49]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:42 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 Jul 08 18:26:42 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:42 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae" returned: 0 in 0.900s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4afd104-674b-4acc-a17c-a378b56b703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da158018-b34e-45c0-99c2-7487d0e7d3ae', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed71b04-23fb-4197-a11c-ce3abd6f2638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:42 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Volume volume-da158018-b34e-45c0-99c2-7487d0e7d3ae (da158018-b34e-45c0-99c2-7487d0e7d3ae): created successfully Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed71b04-23fb-4197-a11c-ce3abd6f2638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Flow 'volume_create_manager' (1c601506-ce3b-4433-8020-805429ecaee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7e698cdb-04b2-4284-8a93-6e82e6579f5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created volume successfully. Jul 08 18:26:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-da158018-b34e-45c0-99c2-7487d0e7d3ae-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-da158018-b34e-45c0-99c2-7487d0e7d3ae-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-quobyte-da158018-b34e-45c0-99c2-7487d0e7d3ae" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-da158018-b34e-45c0-99c2-7487d0e7d3ae" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:43 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" returned: 0 in 1.048s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe237283-0aa5-45d8-b73e-31d4a267779c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:43 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 Jul 08 18:26:43 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:43 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae Jul 08 18:26:43 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:44 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Flow 'volume_create_manager' (0de6f205-fc17-43f6-8b69-2cc1edef4b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997f2624-e971-4ad5-ab24-75d286da7682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae" returned: 0 in 0.953s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:44 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae Jul 08 18:26:44 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997f2624-e971-4ad5-ab24-75d286da7682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-293243429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a69396b-1a37-4d81-a1d3-bff230211024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4565a90de0fc475da8905b944eb99be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:44Z,use_quota=True,user_id='7c3b99bdcdff478bb224fed6db9c1326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0832f3a-f4f4-4374-8287-9095ba4fe216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0832f3a-f4f4-4374-8287-9095ba4fe216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a711fcfb-f697-449a-87b8-2236a1a3c2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a711fcfb-f697-449a-87b8-2236a1a3c2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a69396b-1a37-4d81-a1d3-bff230211024', 'volume_name': 'volume-2a69396b-1a37-4d81-a1d3-bff230211024', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fd7bd8-b7a0-4d33-81f2-350663ff8e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fd7bd8-b7a0-4d33-81f2-350663ff8e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c779df-2325-4f2b-a391-e83e5f147ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:44 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Volume 2a69396b-1a37-4d81-a1d3-bff230211024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a69396b-1a37-4d81-a1d3-bff230211024', 'volume_size': 1} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-293243429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a69396b-1a37-4d81-a1d3-bff230211024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4565a90de0fc475da8905b944eb99be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:44Z,use_quota=True,user_id='7c3b99bdcdff478bb224fed6db9c1326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Creating volume 2a69396b-1a37-4d81-a1d3-bff230211024 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:44 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:44 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 1073741824 Jul 08 18:26:44 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:44 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7" returned: 0 in 1.162s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:44 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7 Jul 08 18:26:44 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:44 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-da158018-b34e-45c0-99c2-7487d0e7d3ae" returned: 0 in 0.683s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-da158018-b34e-45c0-99c2-7487d0e7d3ae" released by "delete_volume" :: held 1.700s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:44 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created reservations ['3d8a0283-9913-4e4c-8ca9-17dfbea7dda1', '28f3e15e-b345-4555-98f1-e1f0a54b00d8', '19db1a53-eb0a-4660-a246-1a4a8a59c3c9', '17bae503-9c82-4981-99c2-b09e9ff0524d'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:45 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:45 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:45 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2.bd8e47b2-c530-4318-8bcb-d308ac3471d7" returned: 0 in 0.789s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-quobyte-bd8e47b2-c530-4318-8bcb-d308ac3471d7" released by "_delete_snapshot" :: held 4.336s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-quobyte-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" released by "delete_snapshot" :: held 4.371s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Created reservations ['9611c740-46b6-4694-ac8e-7d2b1a30d3d6', 'd9efae17-f953-4ad9-9cf4-1cb850532290', '36b77867-eb91-465c-b1cf-18dd69538837', 'a97f5972-7fe1-4098-b1df-9772cabb858d'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-973ca99a-5e8c-430f-b224-3378d1b0d5d7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-973ca99a-5e8c-430f-b224-3378d1b0d5d7-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:45 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Delete snapshot completed successfully. Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 1073741824" returned: 0 in 1.194s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-78c58139-a8ad-4d6b-af08-e9e408bba6ef tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-bd8e47b2-c530-4318-8bcb-d308ac3471d7-delete_snapshot" released by "delete_snapshot" :: held 4.702s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-quobyte-973ca99a-5e8c-430f-b224-3378d1b0d5d7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-973ca99a-5e8c-430f-b224-3378d1b0d5d7" acquired by "delete_volume" :: waited 0.035s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3cb44e-ff58-4bb9-ad2a-ee7951d101d7]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:45 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 Jul 08 18:26:45 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:45 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 Jul 08 18:26:45 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:46 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.919s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Deleted volume successfully. Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5340b58d-de71-4cc9-b01d-6a8a754fa363 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-da158018-b34e-45c0-99c2-7487d0e7d3ae-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "cinder-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:46 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024" returned: 0 in 0.829s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c779df-2325-4f2b-a391-e83e5f147ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a69396b-1a37-4d81-a1d3-bff230211024', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c90a5e0-ca7e-4e21-a52b-f0422bb1d160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:46 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Volume volume-2a69396b-1a37-4d81-a1d3-bff230211024 (2a69396b-1a37-4d81-a1d3-bff230211024): created successfully Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c90a5e0-ca7e-4e21-a52b-f0422bb1d160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Flow 'volume_create_manager' (0de6f205-fc17-43f6-8b69-2cc1edef4b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "cinder-quobyte-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-91cc7abd-b92b-4eba-a68c-245db9bcff1d tempest-VolumesTransfersV357Test-1657639143 None] Created volume successfully. Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-quobyte-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" acquired by "delete_volume" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdcbb40-fb39-4872-a511-8f977e0184c6]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:46 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7" returned: 0 in 0.997s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:46 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7 Jul 08 18:26:46 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:46 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 Jul 08 18:26:46 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:47 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-973ca99a-5e8c-430f-b224-3378d1b0d5d7" returned: 0 in 0.691s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-973ca99a-5e8c-430f-b224-3378d1b0d5d7" released by "delete_volume" :: held 1.739s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created reservations ['debcdc3f-4f0c-4e35-b8f4-a098a460754f', 'bf32716e-17ce-41ae-aeda-f5cd9116442a', '2164aa77-3902-464f-a345-8bae7ff3aa61', '4b1521a3-a4b6-486e-945e-419088843498'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:47 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" returned: 0 in 0.911s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:47 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2 Jul 08 18:26:47 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:47 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:47 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-5871bf5d-efe7-4c1f-885a-edc7aa868146-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-5871bf5d-efe7-4c1f-885a-edc7aa868146-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-quobyte-5871bf5d-efe7-4c1f-885a-edc7aa868146" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-5871bf5d-efe7-4c1f-885a-edc7aa868146" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0802be5-6f8c-4ef5-a264-1b187310da4f]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:48 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 Jul 08 18:26:48 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:48 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-41d1622d-28e2-4733-8b22-4d0eff787124 tempest-VolumesTransfersV357Test-1038581692 None] Transfer volume completed successfully. Jul 08 18:26:48 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.955s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:48 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Deleted volume successfully. Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c50cf9b6-0bdf-4002-8c4a-5d46ca328c5e tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-973ca99a-5e8c-430f-b224-3378d1b0d5d7-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:48 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" returned: 0 in 1.296s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-quobyte-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2" released by "delete_volume" :: held 2.276s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Created reservations ['87f53f9f-026e-4747-a4a0-61f35e62451c', '3d916e5a-55f4-4136-9e36-73798bb04fe3', 'c43fb2a1-81cc-40c4-af74-b7024dae9ee9', '07d60ff3-8938-464c-92b0-0fadc2a1eae4'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:49 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:49 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:49 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146" returned: 0 in 1.273s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:49 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146 Jul 08 18:26:49 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Acquiring lock "cinder-2a69396b-1a37-4d81-a1d3-bff230211024-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Lock "cinder-2a69396b-1a37-4d81-a1d3-bff230211024-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Acquiring lock "cinder-quobyte-2a69396b-1a37-4d81-a1d3-bff230211024" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Lock "cinder-quobyte-2a69396b-1a37-4d81-a1d3-bff230211024" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "cinder-faa7f62b-976e-4b13-a935-1ab87cff3507-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d797aa6-bf7c-4da4-95ad-2614abafc974]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-faa7f62b-976e-4b13-a935-1ab87cff3507-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "cinder-quobyte-faa7f62b-976e-4b13-a935-1ab87cff3507" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:49 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.981s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Deleted volume successfully. Jul 08 18:26:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-quobyte-faa7f62b-976e-4b13-a935-1ab87cff3507" acquired by "delete_volume" :: waited 0.063s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-967889dc-a7da-4c64-a656-5f8fc4e2fc16 tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-7e8a4f2f-5e67-4c3e-a951-ce39bbcef3e2-delete_volume" released by "delete_volume" :: held 3.635s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4249fc-3079-481e-9365-d9b1cd486474]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:50 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 Jul 08 18:26:50 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:50 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 Jul 08 18:26:50 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:50 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5871bf5d-efe7-4c1f-885a-edc7aa868146" returned: 0 in 1.121s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-5871bf5d-efe7-4c1f-885a-edc7aa868146" released by "delete_volume" :: held 2.462s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created reservations ['c7d6788f-bc83-4b16-afc7-e7b3f970ce2e', '9cef132d-3a9d-4c90-a946-a1018f5dcb0a', 'd14ab010-9760-4ad5-9e0b-92b99d59c52d', 'db0419e6-2c44-413f-8d69-f757f59382fe'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:50 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:50 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:51 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024" returned: 0 in 1.210s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:51 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:51 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024 Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507" returned: 0 in 1.030s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:51 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:51 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507 Jul 08 18:26:51 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-05564a0c-1d8b-47c5-908b-313ee11680d5-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:51 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.818s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-05564a0c-1d8b-47c5-908b-313ee11680d5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Deleted volume successfully. Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e598bc11-f4f3-48b6-8ce1-16a5114f3ab0 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-5871bf5d-efe7-4c1f-885a-edc7aa868146-delete_volume" released by "delete_volume" :: held 3.576s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-quobyte-05564a0c-1d8b-47c5-908b-313ee11680d5" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-05564a0c-1d8b-47c5-908b-313ee11680d5" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8b0176-bf70-4d8a-8d16-90d0809931df]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:51 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 Jul 08 18:26:51 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:51 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2a69396b-1a37-4d81-a1d3-bff230211024" returned: 0 in 0.929s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:51 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-faa7f62b-976e-4b13-a935-1ab87cff3507" returned: 0 in 0.898s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Lock "cinder-quobyte-2a69396b-1a37-4d81-a1d3-bff230211024" released by "delete_volume" :: held 2.227s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-quobyte-faa7f62b-976e-4b13-a935-1ab87cff3507" released by "delete_volume" :: held 2.010s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Created reservations ['0263c052-4664-4ee4-b619-745d2994b35c', 'e19a0290-a227-4948-9acf-9df042f7d52e', 'e20fe28d-b7db-40a4-86ba-fd96d2efc6ff', '1dfe70a1-bfc4-4bdf-a25d-44ac265e64c2'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Created reservations ['deaaace2-5030-43e1-88da-947506e5ff74', 'bffe3a80-7f23-4d54-a0e1-a309218cdf62', 'e8aee986-a6d8-4ef9-b662-cc4241c9a1d4', 'f0103edc-ac01-49e6-a62f-fa473ccac9aa'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:52 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:52 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:52 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:52 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:52 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5" returned: 0 in 1.300s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:52 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5 Jul 08 18:26:52 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:53 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.025s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:53 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:53 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Deleted volume successfully. Jul 08 18:26:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c027ff86-0d7e-4784-89ed-1ec835a79244 tempest-CinderUnicodeTest-1379090199 None] Lock "cinder-faa7f62b-976e-4b13-a935-1ab87cff3507-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:53 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.209s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:53 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:53 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Deleted volume successfully. Jul 08 18:26:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-46549c92-2334-410e-af3c-cfa50f14198b tempest-VolumesTransfersV357Test-1469348384 None] Lock "cinder-2a69396b-1a37-4d81-a1d3-bff230211024-delete_volume" released by "delete_volume" :: held 3.911s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:53 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-05564a0c-1d8b-47c5-908b-313ee11680d5" returned: 0 in 1.229s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-05564a0c-1d8b-47c5-908b-313ee11680d5" released by "delete_volume" :: held 2.624s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Flow 'volume_create_manager' (b2cf24ad-16d6-412d-8174-43b73d117b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c383fbf-9301-4baf-81cd-298898a3f5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c383fbf-9301-4baf-81cd-298898a3f5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-80814742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4565a90de0fc475da8905b944eb99be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:54Z,use_quota=True,user_id='7c3b99bdcdff478bb224fed6db9c1326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c3ee7a-8c98-4a0f-9238-38b2d26e354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c3ee7a-8c98-4a0f-9238-38b2d26e354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4208faa4-90a8-45e7-8032-29ecebf1e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4208faa4-90a8-45e7-8032-29ecebf1e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d', 'volume_name': 'volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955996c1-770e-49c5-90d4-56144ec3567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955996c1-770e-49c5-90d4-56144ec3567d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63f1078-0577-40cf-9b80-eeeca9294229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:54 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Volume cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d', 'volume_size': 1} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-80814742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4565a90de0fc475da8905b944eb99be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:54Z,use_quota=True,user_id='7c3b99bdcdff478bb224fed6db9c1326',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Creating volume cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:54 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:54 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d 1073741824 Jul 08 18:26:54 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created reservations ['3cd85e30-3471-41c3-abc0-dcc9a442a297', '2e8ab6fe-a3dd-493c-83fd-252c2a976c3d', '60826806-2a27-49c2-b7ab-f57b7f39f34c', '50beb8ae-6fb5-4dcf-b186-02ae5f853b23'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:54 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:54 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-707584af-6490-471a-b1fd-37f97d69cfbe-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-707584af-6490-471a-b1fd-37f97d69cfbe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-quobyte-707584af-6490-471a-b1fd-37f97d69cfbe" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-707584af-6490-471a-b1fd-37f97d69cfbe" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b548a-ca52-4f2e-b87e-f3c7b99bdaca]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:55 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.770s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:55 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Deleted volume successfully. Jul 08 18:26:55 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe Jul 08 18:26:55 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0599e97d-36a9-4746-b38a-193de8c8816d tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-05564a0c-1d8b-47c5-908b-313ee11680d5-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:55 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d 1073741824" returned: 0 in 1.122s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:55 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d Jul 08 18:26:55 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:55 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe" returned: 0 in 0.903s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:55 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe Jul 08 18:26:55 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:55 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d" returned: 0 in 0.697s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63f1078-0577-40cf-9b80-eeeca9294229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19e682d-cd25-49ec-a189-a20006c5b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:56 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Volume volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d (cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d): created successfully Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19e682d-cd25-49ec-a189-a20006c5b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Flow 'volume_create_manager' (b2cf24ad-16d6-412d-8174-43b73d117b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0a1b6e37-1796-4838-aec4-3873897654ba tempest-VolumesTransfersV357Test-1657639143 None] Created volume successfully. Jul 08 18:26:56 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-707584af-6490-471a-b1fd-37f97d69cfbe" returned: 0 in 0.737s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-707584af-6490-471a-b1fd-37f97d69cfbe" released by "delete_volume" :: held 1.706s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created reservations ['3d1be1bc-7bd3-4106-8784-b7a102364a9d', '0e7e8e09-bd08-46a7-bec9-bf436bd4bab2', '482f33b9-3258-4d44-bde2-4dc89aebda39', '119fceb9-a46b-4176-a4cd-23968458f287'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:56 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:56 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Flow 'volume_create_manager' (662716c8-b38a-43da-bcfb-06a487b172f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c24769-b207-45a4-996c-d04a3f79d884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c24769-b207-45a4-996c-d04a3f79d884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487774344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadc94a4-2bf2-4524-90de-75d61a8f9c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548acbce57da4d41a1054ce6b3fd460f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:57Z,use_quota=True,user_id='f22f489aba574ce1b1364fc805b6cf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e67e4-a1d0-4d54-b6fc-0ee637dfd394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0e67e4-a1d0-4d54-b6fc-0ee637dfd394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed532d5-af8e-4480-81b2-9d87dee51793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed532d5-af8e-4480-81b2-9d87dee51793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadc94a4-2bf2-4524-90de-75d61a8f9c33', 'volume_name': 'volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43da0e4-7ab8-455e-a6f8-1580dfb51504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43da0e4-7ab8-455e-a6f8-1580dfb51504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55829a7-7a58-4852-9cf4-8404aa372642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:57 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Volume eadc94a4-2bf2-4524-90de-75d61a8f9c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33', 'volume_size': 1} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487774344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadc94a4-2bf2-4524-90de-75d61a8f9c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548acbce57da4d41a1054ce6b3fd460f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:26:57Z,use_quota=True,user_id='f22f489aba574ce1b1364fc805b6cf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Creating volume eadc94a4-2bf2-4524-90de-75d61a8f9c33 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:26:57 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-1648161f-4dca-4065-bd96-7f07c54a911d-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:57 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 1073741824 Jul 08 18:26:57 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-1648161f-4dca-4065-bd96-7f07c54a911d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "cinder-quobyte-1648161f-4dca-4065-bd96-7f07c54a911d" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-1648161f-4dca-4065-bd96-7f07c54a911d" acquired by "delete_volume" :: waited 0.036s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd89089-e882-4bd3-abaf-ff0a7f634a5e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:57 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.833s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:26:57 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Deleted volume successfully. Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7b959716-a923-43fd-8296-b97f6540b614 tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-707584af-6490-471a-b1fd-37f97d69cfbe-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:57 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d Jul 08 18:26:57 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Acquiring lock "cinder-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Lock "cinder-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Acquiring lock "cinder-quobyte-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Lock "cinder-quobyte-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[493ae340-79eb-4c34-bb90-e22972f0e411]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:26:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:57 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d Jul 08 18:26:57 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:58 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 1073741824" returned: 0 in 1.002s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:58 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 Jul 08 18:26:58 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:58 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d" returned: 0 in 0.968s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:58 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d Jul 08 18:26:58 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:58 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d" returned: 0 in 0.859s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:58 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d Jul 08 18:26:58 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:59 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33" returned: 0 in 0.756s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55829a7-7a58-4852-9cf4-8404aa372642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1146ee-feee-4449-b582-123c0d5bd860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:26:59 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Volume volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 (eadc94a4-2bf2-4524-90de-75d61a8f9c33): created successfully Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1146ee-feee-4449-b582-123c0d5bd860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Flow 'volume_create_manager' (662716c8-b38a-43da-bcfb-06a487b172f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:26:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5dc07d6d-413d-4f02-bf1e-3cee266c9153 tempest-ProjectReaderTests-254264439 None] Created volume successfully. Jul 08 18:26:59 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1648161f-4dca-4065-bd96-7f07c54a911d" returned: 0 in 0.728s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-quobyte-1648161f-4dca-4065-bd96-7f07c54a911d" released by "delete_volume" :: held 1.760s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Created reservations ['7645967f-5015-4602-b389-19549266393e', '01a64d47-0c4f-4d61-be07-983da3e46e60', '1373d8e7-9e8d-4016-a3c7-6eacc05ba40f', 'c7c3ed96-3c47-445d-958e-a8c7d59c40ac'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:59 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:59 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:26:59 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d" returned: 0 in 0.738s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Lock "cinder-quobyte-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d" released by "delete_volume" :: held 1.643s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Created reservations ['eb88baa3-ad43-423b-8ba8-65354f3d1dc0', '36e4a07b-b8d6-4d60-be75-d74802ac4ddc', '7b3cf697-466e-4e13-a955-b3ac21f93a86', '21aab00b-869d-419d-beb0-c9a8de28b688'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:26:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:26:59 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:26:59 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:00 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.767s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:00 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Deleted volume successfully. Jul 08 18:27:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8fc4767f-f7a0-45bf-a82d-01f4914614af tempest-CreateVolumesFromSourceVolumeTest-1391342242 None] Lock "cinder-1648161f-4dca-4065-bd96-7f07c54a911d-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:00 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.127s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:00 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Deleted volume successfully. Jul 08 18:27:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-73578e45-847b-4d1f-9aa0-432eb291b855 tempest-VolumesTransfersV357Test-1469348384 None] Lock "cinder-cfc3f10a-42b6-4a2a-9c9d-1095fc15c60d-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Acquiring lock "cinder-eadc94a4-2bf2-4524-90de-75d61a8f9c33-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Lock "cinder-eadc94a4-2bf2-4524-90de-75d61a8f9c33-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Acquiring lock "cinder-quobyte-eadc94a4-2bf2-4524-90de-75d61a8f9c33" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Lock "cinder-quobyte-eadc94a4-2bf2-4524-90de-75d61a8f9c33" acquired by "delete_volume" :: waited 0.042s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:01 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9807397b-ba39-46c6-a6b0-37c80d1e2790]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:01 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 Jul 08 18:27:01 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:02 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33" returned: 0 in 0.974s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:02 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33 Jul 08 18:27:02 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:02 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:02 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:03 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-eadc94a4-2bf2-4524-90de-75d61a8f9c33" returned: 0 in 0.953s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Lock "cinder-quobyte-eadc94a4-2bf2-4524-90de-75d61a8f9c33" released by "delete_volume" :: held 2.021s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Created reservations ['fb24c987-a957-4146-b7ea-5bb3b2d755c1', '6b353136-6110-476a-8f76-f0415bf8ed82', '55286ae8-09cb-4926-8d86-2ca16dbbebad', '8491611e-815f-4fe8-ad9c-dd935a725f25'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:03 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:03 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:03 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.139s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:27:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Flow 'volume_create_manager' (af7b7a3e-f265-41de-aa78-2476680ae5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a1700b-3a9f-4175-bb37-04fe213a9ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a1700b-3a9f-4175-bb37-04fe213a9ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1426601740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe4663d-7449-4cd0-9ad2-1a994eeb47ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfcaf624df744d393752d04eacc5bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:04Z,use_quota=True,user_id='294396eeaa7a4f69ac25542ff63b0ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5bc35e-6b45-4524-8d7d-e487a1fe0cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5bc35e-6b45-4524-8d7d-e487a1fe0cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5697db14-f121-4339-8466-3f9e9026e788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:04 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5697db14-f121-4339-8466-3f9e9026e788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe4663d-7449-4cd0-9ad2-1a994eeb47ce', 'volume_name': 'volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f9c0ea-aae4-4630-ada3-ec7a3016dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f9c0ea-aae4-4630-ada3-ec7a3016dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbe9333-b188-46e2-9a6c-54582d6a09fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:04 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Volume cbe4663d-7449-4cd0-9ad2-1a994eeb47ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce', 'volume_size': 1} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1426601740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe4663d-7449-4cd0-9ad2-1a994eeb47ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfcaf624df744d393752d04eacc5bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:04Z,use_quota=True,user_id='294396eeaa7a4f69ac25542ff63b0ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Creating volume cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:27:04 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.985s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Deleted volume successfully. Jul 08 18:27:04 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce 1073741824 Jul 08 18:27:04 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3b277821-b37f-45d5-beb0-0b2cd9d76b86 tempest-ProjectReaderTests-254264439 None] Lock "cinder-eadc94a4-2bf2-4524-90de-75d61a8f9c33-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Flow 'volume_create_manager' (86578736-1cb1-41c4-bbe2-e3fd719060a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e40f78-52d3-4414-8b83-60b7e471f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e40f78-52d3-4414-8b83-60b7e471f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842158275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a46b52-d42a-4ec2-bea9-1fdb09b1f650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548acbce57da4d41a1054ce6b3fd460f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:05Z,use_quota=True,user_id='f22f489aba574ce1b1364fc805b6cf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9860bef-1365-4bac-8bfa-5037c3b8f343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9860bef-1365-4bac-8bfa-5037c3b8f343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea5c45e-2194-4688-9083-73161af00d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea5c45e-2194-4688-9083-73161af00d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a46b52-d42a-4ec2-bea9-1fdb09b1f650', 'volume_name': 'volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8e2f4c-a8fd-4f00-9764-0da60bc5ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8e2f4c-a8fd-4f00-9764-0da60bc5ef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25ca3bb-6837-4e90-9f5d-b0fceb43836d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Volume 78a46b52-d42a-4ec2-bea9-1fdb09b1f650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650', 'volume_size': 1} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:05 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce 1073741824" returned: 0 in 1.221s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:05 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce Jul 08 18:27:05 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:06 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" returned: 0 in 0.707s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.109s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842158275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a46b52-d42a-4ec2-bea9-1fdb09b1f650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548acbce57da4d41a1054ce6b3fd460f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:05Z,use_quota=True,user_id='f22f489aba574ce1b1364fc805b6cf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Creating volume 78a46b52-d42a-4ec2-bea9-1fdb09b1f650 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:27:06 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbe9333-b188-46e2-9a6c-54582d6a09fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:06 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 1073741824 Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3c9b2d-fdc8-412a-bc13-f77a0b43c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:06 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:06 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Volume volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce (cbe4663d-7449-4cd0-9ad2-1a994eeb47ce): created successfully Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3c9b2d-fdc8-412a-bc13-f77a0b43c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Flow 'volume_create_manager' (af7b7a3e-f265-41de-aa78-2476680ae5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2e292b47-bf57-486f-be75-65acfc54edc0 tempest-VolumeDependencyTests-1886888561 None] Created volume successfully. Jul 08 18:27:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-6fa6b9d5-5ca9-4dd9-b172-140bac506364 req-2c3f3dd7-7142-4fbf-a053-fdf2cb770950 tempest-TestMinimumBasicScenario-1691688240 None] Terminate volume connection completed successfully. Jul 08 18:27:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-6fa6b9d5-5ca9-4dd9-b172-140bac506364 req-2c3f3dd7-7142-4fbf-a053-fdf2cb770950 tempest-TestMinimumBasicScenario-1691688240 None] Deleting attachment 4d8b0046-668f-4048-8653-a4f693b6fff3. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:27:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:07 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 1073741824" returned: 0 in 1.089s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:07 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 Jul 08 18:27:07 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:08 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650" returned: 0 in 0.660s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.731s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25ca3bb-6837-4e90-9f5d-b0fceb43836d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee5d122-dad0-49da-b7bd-17ba8089f2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Creating offline snapshot 7c99755a-42c5-4dbb-bb66-f08157e145ab of volume cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:27:08 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Volume volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 (78a46b52-d42a-4ec2-bea9-1fdb09b1f650): created successfully Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee5d122-dad0-49da-b7bd-17ba8089f2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Flow 'volume_create_manager' (86578736-1cb1-41c4-bbe2-e3fd719060a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[df42f074-5b26-46a5-90de-6b0d4bf8084e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:08 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7ecee6c1-89f7-4d80-9879-36c655a45c63 tempest-ProjectReaderTests-254264439 None] Created volume successfully. Jul 08 18:27:08 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce Jul 08 18:27:08 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Flow 'volume_create_manager' (739a3e38-2a4a-4dd4-8b0b-b2e99bf1a2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f10039-ecaa-4380-9096-57b746705ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f10039-ecaa-4380-9096-57b746705ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-491493015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f179278-e641-41b6-aaaf-671acdc21f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9585e5b674470abd7b6fbcbfb5c26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:09Z,use_quota=True,user_id='73f93aa021744b82b6e1e45fd088c79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1972b550-468a-47db-ae64-a625a8d71b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1972b550-468a-47db-ae64-a625a8d71b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b15035a-0bc9-46ef-87f8-a77d3fc87510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Acquiring lock "cinder-8c7db880-875c-4640-95df-0567ecf6edda-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:09 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" returned: 0 in 1.011s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Lock "cinder-8c7db880-875c-4640-95df-0567ecf6edda-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:09 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab 1G Jul 08 18:27:09 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Acquiring lock "cinder-quobyte-8c7db880-875c-4640-95df-0567ecf6edda" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b15035a-0bc9-46ef-87f8-a77d3fc87510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f179278-e641-41b6-aaaf-671acdc21f20', 'volume_name': 'volume-3f179278-e641-41b6-aaaf-671acdc21f20', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3308690-4736-4954-8a3f-9c51ad4f459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3308690-4736-4954-8a3f-9c51ad4f459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdba380d-ba9e-4166-9180-cc48d0f0a818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:09 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Volume 3f179278-e641-41b6-aaaf-671acdc21f20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f179278-e641-41b6-aaaf-671acdc21f20', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Trying to clone 3f179278-e641-41b6-aaaf-671acdc21f20 from image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Lock "cinder-quobyte-8c7db880-875c-4640-95df-0567ecf6edda" acquired by "delete_volume" :: waited 0.048s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Acquiring lock "cinder-78a46b52-d42a-4ec2-bea9-1fdb09b1f650-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[704a8147-d50d-41aa-9cd1-b9d0ecf5eb41]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Lock "cinder-78a46b52-d42a-4ec2-bea9-1fdb09b1f650-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Acquiring lock "cinder-quobyte-78a46b52-d42a-4ec2-bea9-1fdb09b1f650" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Lock "cinder-quobyte-78a46b52-d42a-4ec2-bea9-1fdb09b1f650" acquired by "delete_volume" :: waited 0.030s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:09 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda Jul 08 18:27:09 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d67543c-ef6c-4efc-afe8-2d24f3a98c5b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:09 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 Jul 08 18:27:09 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:27:09 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff185be-8f11-4d3f-b540-7aec7f65b679]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:10 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD Jul 08 18:27:10 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:10 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab 1G" returned: 0 in 1.057s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:10 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab Jul 08 18:27:10 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:10 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda" returned: 0 in 1.046s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:10 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda Jul 08 18:27:10 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:10 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650" returned: 0 in 0.957s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:10 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650 Jul 08 18:27:10 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:10 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD" returned: 0 in 0.868s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Temporary image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 is fetched for user 73f93aa021744b82b6e1e45fd088c79c. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8105d4-ae64-485b-a6a8-fc5514e2af24]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:10 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD Jul 08 18:27:10 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:11 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab" returned: 0 in 0.859s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:11 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab is being set with open permissions: ugo+rw Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:11 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab Jul 08 18:27:11 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:11 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8c7db880-875c-4640-95df-0567ecf6edda" returned: 0 in 0.758s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Lock "cinder-quobyte-8c7db880-875c-4640-95df-0567ecf6edda" released by "delete_volume" :: held 1.874s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:11 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-78a46b52-d42a-4ec2-bea9-1fdb09b1f650" returned: 0 in 0.757s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Created reservations ['45ecaf1a-9cad-4a43-a93c-4885ccad674e', '8b43b95e-e33e-4cba-a152-43663ad929e8', 'd31581bf-fea2-4ec4-b86f-4f40c931ccb7', '97aeea2e-fa39-425f-94b8-3baa52c16cf2'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Lock "cinder-quobyte-78a46b52-d42a-4ec2-bea9-1fdb09b1f650" released by "delete_volume" :: held 1.777s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:11 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:11 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Created reservations ['a4bbfb3b-f4e2-49a1-a3b7-14d0596c1222', '8bb03066-ce09-42d1-aa8a-34e6c277f55f', 'ee0f082a-dffe-4d97-bcc1-ffa8458f0b9c', '1cf97ff6-d560-44b9-bf75-4e1b1bffd46f'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:11 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:11 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:11 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD" returned: 0 in 1.050s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:12 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab" returned: 0 in 1.128s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:12 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.info Jul 08 18:27:12 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:12 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.053s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Deleted volume successfully. Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Flow 'volume_create_manager' (d426c3dc-23ed-45d3-aac9-f4c897e6e0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:12 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188daaf1-651d-4242-b71d-199422349e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e37c4ef-d4d3-46fd-86da-393703e535f4 tempest-TestMinimumBasicScenario-1691688240 None] Lock "cinder-8c7db880-875c-4640-95df-0567ecf6edda-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.996s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Deleted volume successfully. Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188daaf1-651d-4242-b71d-199422349e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1365751859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c864789c-1cc0-4f70-984a-795a42aa40c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548acbce57da4d41a1054ce6b3fd460f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:12Z,use_quota=True,user_id='f22f489aba574ce1b1364fc805b6cf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef72561-67ba-4aec-81b0-0818ce7e5f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef72561-67ba-4aec-81b0-0818ce7e5f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee900fca-1ed4-431b-9a8a-8153531461f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee900fca-1ed4-431b-9a8a-8153531461f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c864789c-1cc0-4f70-984a-795a42aa40c1', 'volume_name': 'volume-c864789c-1cc0-4f70-984a-795a42aa40c1', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098fdbec-5168-46bd-b4ec-a7ccab5f023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098fdbec-5168-46bd-b4ec-a7ccab5f023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4092780b-4504-4c56-a782-c982d5dd6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Volume c864789c-1cc0-4f70-984a-795a42aa40c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c864789c-1cc0-4f70-984a-795a42aa40c1', 'volume_size': 1} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8c37fb8d-cac7-4a71-93f0-4bec2cd249e1 tempest-ProjectReaderTests-254264439 None] Lock "cinder-78a46b52-d42a-4ec2-bea9-1fdb09b1f650-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:13 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.info" returned: 0 in 0.720s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:13 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.info is being set with open permissions: ugo+rw Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:13 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.info Jul 08 18:27:13 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:13 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.info" returned: 0 in 0.771s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.671s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-491493015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f179278-e641-41b6-aaaf-671acdc21f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9585e5b674470abd7b6fbcbfb5c26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:09Z,use_quota=True,user_id='73f93aa021744b82b6e1e45fd088c79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Creating volume 3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:27:13 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:27:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:13 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 1073741824 Jul 08 18:27:13 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:13 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1dadfaff-d497-4bfc-acc3-5f81847dbba5 tempest-VolumeDependencyTests-1886888561 None] Create snapshot completed successfully Jul 08 18:27:14 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 1073741824" returned: 0 in 0.934s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:14 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:14 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Flow 'volume_create_manager' (199e8f1b-ef47-42d5-bdc4-4e276ea8ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd326d24-ef64-4341-9537-c525d598031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd326d24-ef64-4341-9537-c525d598031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-740975933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b506cf-177d-437b-8362-ab8c4f923b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfcaf624df744d393752d04eacc5bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7c99755a-42c5-4dbb-bb66-f08157e145ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:15Z,use_quota=True,user_id='294396eeaa7a4f69ac25542ff63b0ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8428c74-0124-4d23-a836-28fcb69e4dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8428c74-0124-4d23-a836-28fcb69e4dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcfd342-4010-4aae-a372-86ecffa2440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcfd342-4010-4aae-a372-86ecffa2440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00b506cf-177d-437b-8362-ab8c4f923b8c', 'volume_name': 'volume-00b506cf-177d-437b-8362-ab8c4f923b8c', 'volume_size': 1, 'snapshot_id': '7c99755a-42c5-4dbb-bb66-f08157e145ab'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4928015e-b2da-4a87-9c45-086beb5abf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4928015e-b2da-4a87-9c45-086beb5abf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4529d675-fc44-42b2-8491-6b2ccf9c438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:15 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Volume 00b506cf-177d-437b-8362-ab8c4f923b8c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00b506cf-177d-437b-8362-ab8c4f923b8c', 'volume_size': 1, 'snapshot_id': '7c99755a-42c5-4dbb-bb66-f08157e145ab'} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:15 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 0 in 0.722s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.943s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1365751859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c864789c-1cc0-4f70-984a-795a42aa40c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548acbce57da4d41a1054ce6b3fd460f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:12Z,use_quota=True,user_id='f22f489aba574ce1b1364fc805b6cf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Creating volume c864789c-1cc0-4f70-984a-795a42aa40c1 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:27:15 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:15 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 1073741824 Jul 08 18:27:15 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Attempting download of 2c4a33de-7646-4da0-8ea3-4caf9de5a137 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}])) to volume 3f179278-e641-41b6-aaaf-671acdc21f20. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98bad2c-c745-43bd-af72-df424f508121]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_fw8mryyw {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:15 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_fw8mryyw Jul 08 18:27:15 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:16 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_fw8mryyw" returned: 0 in 0.864s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_fw8mryyw {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:16 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 1073741824" returned: 0 in 0.961s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:16 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 Jul 08 18:27:16 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:16 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_fw8mryyw Jul 08 18:27:16 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:17 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1" returned: 0 in 0.720s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:17 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.768s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-quobyte-7c99755a-42c5-4dbb-bb66-f08157e145ab-00b506cf-177d-437b-8362-ab8c4f923b8c" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_fw8mryyw" returned: 1 in 0.782s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137_fw8mryyw' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7d314e-f835-4231-b59b-b978a7ac6b00]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4092780b-4504-4c56-a782-c982d5dd6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c864789c-1cc0-4f70-984a-795a42aa40c1', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457989fc-9020-40a6-89a9-2c28fa887cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-7c99755a-42c5-4dbb-bb66-f08157e145ab-00b506cf-177d-437b-8362-ab8c4f923b8c" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Creating volume 00b506cf-177d-437b-8362-ab8c4f923b8c from snapshot 7c99755a-42c5-4dbb-bb66-f08157e145ab {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-quobyte-00b506cf-177d-437b-8362-ab8c4f923b8c" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:17 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Volume volume-c864789c-1cc0-4f70-984a-795a42aa40c1 (c864789c-1cc0-4f70-984a-795a42aa40c1): created successfully Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457989fc-9020-40a6-89a9-2c28fa887cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Flow 'volume_create_manager' (d426c3dc-23ed-45d3-aac9-f4c897e6e0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-00b506cf-177d-437b-8362-ab8c4f923b8c" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] snapshot: 7c99755a-42c5-4dbb-bb66-f08157e145ab, volume: 00b506cf-177d-437b-8362-ab8c4f923b8c, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:27:17 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD Jul 08 18:27:17 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:17 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b39567e4-f36e-477c-a034-34b97fe21268 tempest-ProjectReaderTests-254264439 None] Created volume successfully. Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[448f6712-7b21-4383-a2b7-10dff8802589]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:17 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab Jul 08 18:27:17 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Acquiring lock "cinder-c864789c-1cc0-4f70-984a-795a42aa40c1-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Lock "cinder-c864789c-1cc0-4f70-984a-795a42aa40c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Acquiring lock "cinder-quobyte-c864789c-1cc0-4f70-984a-795a42aa40c1" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Lock "cinder-quobyte-c864789c-1cc0-4f70-984a-795a42aa40c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[13741504-7c12-4427-a0d3-c8b6f1c3ae03]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:18 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 Jul 08 18:27:18 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:18 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] 2c4a33de-7646-4da0-8ea3-4caf9de5a137 was qcow2, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:18 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:18 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:18 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab" returned: 0 in 0.891s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1ec8b5-0805-464a-905e-003dec9905d3]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:18 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce Jul 08 18:27:18 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:18 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1" returned: 0 in 0.925s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:18 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1 Jul 08 18:27:18 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:19 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" returned: 0 in 1.167s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:19 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c Jul 08 18:27:19 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:19 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c864789c-1cc0-4f70-984a-795a42aa40c1" returned: 0 in 0.840s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Lock "cinder-quobyte-c864789c-1cc0-4f70-984a-795a42aa40c1" released by "delete_volume" :: held 1.820s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Created reservations ['702cffad-7f3c-440b-a196-90ff311ca7f1', '277a4252-4538-4bcb-8af7-d47b50eb80d8', '7d6b32f7-8434-47ce-b50e-d333f297b206', 'c5498d61-84fd-4307-9bbb-4209ce8a9ca9'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:19 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:19 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Flow 'volume_create_manager' (ea357a75-f453-45cf-98e4-9c316aeec62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16067809-7b53-48ff-9532-a2c6b43fe511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:20 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16067809-7b53-48ff-9532-a2c6b43fe511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1401338209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25e25eb-d4e2-47c1-9789-a3a3fc89cca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548acbce57da4d41a1054ce6b3fd460f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:21Z,use_quota=True,user_id='f22f489aba574ce1b1364fc805b6cf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4f74d6-aec5-4b12-ad34-15682cffa824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4f74d6-aec5-4b12-ad34-15682cffa824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20288bec-fc22-4a1a-aedf-f8f50fa37a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20288bec-fc22-4a1a-aedf-f8f50fa37a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25e25eb-d4e2-47c1-9789-a3a3fc89cca7', 'volume_name': 'volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b637461-78a0-452c-87d3-09eaad73dff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b637461-78a0-452c-87d3-09eaad73dff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd1c624-16b4-4b87-95fc-a35ed59b84e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:20 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Volume c25e25eb-d4e2-47c1-9789-a3a3fc89cca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7', 'volume_size': 1} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 0 in 2.783s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_8x2tsk5_devstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:27:20 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Converted 112.00 MB image at 40.23 MB/s Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:20 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.056s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:20 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:20 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Deleted volume successfully. Jul 08 18:27:20 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 1G Jul 08 18:27:20 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-501d7509-2c22-40ee-b175-3bf4ee014972 tempest-ProjectReaderTests-254264439 None] Lock "cinder-c864789c-1cc0-4f70-984a-795a42aa40c1-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:23 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 1G" returned: 0 in 2.633s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:23 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[43101678-f644-4281-8ceb-10bcefd00317]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:23 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:23 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:25 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 0 in 2.021s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:25 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c" returned: 0 in 6.079s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:25 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fffd8d1-b440-469d-8516-b059b7261f5b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:25 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:25 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:25 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce Jul 08 18:27:25 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:26 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 1 in 0.970s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Downloaded image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}])) to volume 3f179278-e641-41b6-aaaf-671acdc21f20 successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Temporary image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 for user 73f93aa021744b82b6e1e45fd088c79c is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Marking volume 3f179278-e641-41b6-aaaf-671acdc21f20 as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Copying metadata from image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 to 3f179278-e641-41b6-aaaf-671acdc21f20. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Creating volume glance metadata for volume 3f179278-e641-41b6-aaaf-671acdc21f20 backed by image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdba380d-ba9e-4166-9180-cc48d0f0a818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f179278-e641-41b6-aaaf-671acdc21f20', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e9f61a-10e1-42bf-ae39-65b8a22e26c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:26 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:26 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Volume volume-3f179278-e641-41b6-aaaf-671acdc21f20 (3f179278-e641-41b6-aaaf-671acdc21f20): created successfully Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e9f61a-10e1-42bf-ae39-65b8a22e26c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Flow 'volume_create_manager' (739a3e38-2a4a-4dd4-8b0b-b2e99bf1a2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" returned: 0 in 1.108s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:27:26 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Converted 1024.00 MB image at 168.41 MB/s Jul 08 18:27:26 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c is being set with open permissions: ugo+rw Jul 08 18:27:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:26 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-eb216cc8-4789-45c1-9f2f-599c2228f737 tempest-VolumesExtendTest-231768656 None] Created volume successfully. Jul 08 18:27:26 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c Jul 08 18:27:26 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:27 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c" returned: 0 in 0.716s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-00b506cf-177d-437b-8362-ab8c4f923b8c" released by "_copy_volume_from_snapshot" :: held 10.141s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-7c99755a-42c5-4dbb-bb66-f08157e145ab-00b506cf-177d-437b-8362-ab8c4f923b8c" released by "_create_volume_from_snapshot" :: held 10.192s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.231s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.619s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1401338209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25e25eb-d4e2-47c1-9789-a3a3fc89cca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='548acbce57da4d41a1054ce6b3fd460f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:21Z,use_quota=True,user_id='f22f489aba574ce1b1364fc805b6cf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Creating volume c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:27:27 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:27 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 1073741824 Jul 08 18:27:27 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4529d675-fc44-42b2-8491-6b2ccf9c438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b506cf-177d-437b-8362-ab8c4f923b8c', 'volume_size': 1, 'snapshot_id': '7c99755a-42c5-4dbb-bb66-f08157e145ab'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8149d0f2-1827-4fe1-8784-940a994d48e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:27 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Volume volume-00b506cf-177d-437b-8362-ab8c4f923b8c (00b506cf-177d-437b-8362-ab8c4f923b8c): created successfully Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8149d0f2-1827-4fe1-8784-940a994d48e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Flow 'volume_create_manager' (199e8f1b-ef47-42d5-bdc4-4e276ea8ec75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:27 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-df0b2adf-0d79-4cef-b3e0-2f93ed9b5be8 tempest-VolumeDependencyTests-1886888561 None] Created volume successfully. Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-7c99755a-42c5-4dbb-bb66-f08157e145ab-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-7c99755a-42c5-4dbb-bb66-f08157e145ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-quobyte-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-quobyte-7c99755a-42c5-4dbb-bb66-f08157e145ab" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-7c99755a-42c5-4dbb-bb66-f08157e145ab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Deleting offline snapshot 7c99755a-42c5-4dbb-bb66-f08157e145ab of volume cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] snapshot_file for this snap is: volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c019b1c-bea7-40d7-bd33-6b3d7ff443e8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:28 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab Jul 08 18:27:28 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:28 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 1073741824" returned: 0 in 1.029s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:28 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 Jul 08 18:27:28 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:28 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab" returned: 0 in 0.962s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:27:28 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a18273-1fb2-4e77-992c-e044a0441dce]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:29 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce Jul 08 18:27:29 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:29 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7" returned: 0 in 0.837s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.465s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd1c624-16b4-4b87-95fc-a35ed59b84e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e3939d-2dec-47d8-9485-9a5986bd3a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:29 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Volume volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 (c25e25eb-d4e2-47c1-9789-a3a3fc89cca7): created successfully Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e3939d-2dec-47d8-9485-9a5986bd3a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Flow 'volume_create_manager' (ea357a75-f453-45cf-98e4-9c316aeec62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d85d57-dae5-440f-b165-895f297c77b0]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:29 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6aaf026c-766f-4712-bbd0-f79eb320a847 tempest-ProjectReaderTests-254264439 None] Created volume successfully. Jul 08 18:27:29 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:29 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Acquiring lock "cinder-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Lock "cinder-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:29 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" returned: 0 in 0.991s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Acquiring lock "cinder-quobyte-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:29 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab Jul 08 18:27:29 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Lock "cinder-quobyte-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf7247b-d3ee-46bd-8acf-6db73dbe47b0]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:30 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 Jul 08 18:27:30 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:30 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 0 in 0.951s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:30 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:30 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:30 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab" returned: 0 in 1.005s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:30 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab Jul 08 18:27:30 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:31 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7" returned: 0 in 1.078s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:31 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7 Jul 08 18:27:31 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:31 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 1 in 1.008s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 2G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 2G" returned: 0 in 0.086s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.121s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=158,cinder:DELETE=13,cinder:SELECT=123,cinder:INSERT=46 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=118,cinder:INSERT=45,cinder:UPDATE=174,cinder:DELETE=17 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:27:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-218767d6-19f9-45ee-9137-c1aaad11e6ff tempest-VolumesExtendTest-231768656 None] Extend volume completed successfully. Jul 08 18:27:31 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce.7c99755a-42c5-4dbb-bb66-f08157e145ab" returned: 0 in 0.825s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-7c99755a-42c5-4dbb-bb66-f08157e145ab" released by "_delete_snapshot" :: held 3.936s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" released by "delete_snapshot" :: held 3.962s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Created reservations ['90692970-7e32-4f3d-9789-709146d8a519', '0bd5e405-7cff-4ca6-9fe6-2f5089acd76a', 'b5b83f7a-2cc7-4775-b83c-ec58fb65edb6', '3e66cfe3-2d42-42fe-823b-a847c07ac5f2'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:31 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7" returned: 0 in 0.794s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Lock "cinder-quobyte-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7" released by "delete_volume" :: held 1.952s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Delete snapshot completed successfully. Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-763db365-5220-4e8e-9fd1-48d7d0cf8ccc tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-7c99755a-42c5-4dbb-bb66-f08157e145ab-delete_snapshot" released by "delete_snapshot" :: held 4.166s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:31 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Created reservations ['f3294939-1138-427a-9e09-d3cea6ee49fa', '8e0265f4-439a-4128-83cd-79c86932977c', '09efafff-60b5-49a2-b721-a60617ae5712', 'e571dc17-ee6e-4f97-ac69-91ab5a1af9f5'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:32 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:32 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-quobyte-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bcc776-feac-4820-89f1-7b8f6a86f905]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:32 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce Jul 08 18:27:32 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Acquiring lock "cinder-3f179278-e641-41b6-aaaf-671acdc21f20-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Lock "cinder-3f179278-e641-41b6-aaaf-671acdc21f20-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Acquiring lock "cinder-quobyte-3f179278-e641-41b6-aaaf-671acdc21f20" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Lock "cinder-quobyte-3f179278-e641-41b6-aaaf-671acdc21f20" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a04d4c3-fc3f-47c0-a365-21f914155add]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:32 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.800s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:32 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Deleted volume successfully. Jul 08 18:27:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3aa70d62-a074-4171-aa1e-9da491c40af6 tempest-ProjectReaderTests-254264439 None] Lock "cinder-c25e25eb-d4e2-47c1-9789-a3a3fc89cca7-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:32 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:32 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:33 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" returned: 0 in 0.958s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:33 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce Jul 08 18:27:33 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:33 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 0 in 0.994s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:33 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:33 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:34 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" returned: 0 in 0.827s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce" released by "delete_volume" :: held 1.853s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Created reservations ['ad9db52b-34dc-47a8-a3ae-dd57663a44eb', '1784e1fa-6d1a-48d4-9c7e-e021bd1048fb', '65ecd06e-eb4f-4474-a39f-c8a62262ba2c', '080bede2-04fa-4910-b370-a1510477be9d'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:34 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:34 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-00b506cf-177d-437b-8362-ab8c4f923b8c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-00b506cf-177d-437b-8362-ab8c4f923b8c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "cinder-quobyte-00b506cf-177d-437b-8362-ab8c4f923b8c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-00b506cf-177d-437b-8362-ab8c4f923b8c" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36a18ab-1813-402e-89ae-8665f9a48814]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:34 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c Jul 08 18:27:34 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:34 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 1 in 1.065s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:27:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:34 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20 Jul 08 18:27:34 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:35 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.086s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:35 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Deleted volume successfully. Jul 08 18:27:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-556c5bc3-8169-4bc7-ac2e-6beab6f557b5 tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-cbe4663d-7449-4cd0-9ad2-1a994eeb47ce-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:35 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c" returned: 0 in 1.117s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:35 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c Jul 08 18:27:35 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:35 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3f179278-e641-41b6-aaaf-671acdc21f20" returned: 0 in 1.044s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Lock "cinder-quobyte-3f179278-e641-41b6-aaaf-671acdc21f20" released by "delete_volume" :: held 3.187s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Created reservations ['d6cf608c-b58e-4ac9-8c80-22c531589692', 'ce7183b0-5343-41a8-b680-fdc0b90a7925', '99341ad6-fcb2-4f59-b3dc-1d5ce00d2cd4', 'd059f385-b709-4539-9101-794ecd1030a5'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:36 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:36 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:36 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00b506cf-177d-437b-8362-ab8c4f923b8c" returned: 0 in 0.887s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-quobyte-00b506cf-177d-437b-8362-ab8c4f923b8c" released by "delete_volume" :: held 2.074s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Created reservations ['c2f6e55f-4be5-4210-b9e1-a13c00bb5988', '93e7879a-2fe5-47f1-b96d-b70c7b0580e5', '02dcbcb4-477e-4d99-ba54-aea3e66fde2c', 'a0f81408-4028-4a25-9f71-21bf56401cf2'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:36 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:36 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:36 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.792s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:36 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Deleted volume successfully. Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-9c7934d6-4fd7-4dfc-94e7-c620691b0f98 tempest-VolumesExtendTest-231768656 None] Lock "cinder-3f179278-e641-41b6-aaaf-671acdc21f20-delete_volume" released by "delete_volume" :: held 4.334s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:37 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.787s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:27:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Deleted volume successfully. Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-148defea-9c54-4b57-a577-c4c206e6d79e tempest-VolumeDependencyTests-1886888561 None] Lock "cinder-00b506cf-177d-437b-8362-ab8c4f923b8c-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Flow 'volume_create_manager' (531cd502-0cb1-48cb-9c5c-0d63550538e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6456ac93-375f-44eb-95c5-7416712e844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6456ac93-375f-44eb-95c5-7416712e844e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1943673174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873cbbb0-4a7c-457c-9a82-ccf757a3a471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9585e5b674470abd7b6fbcbfb5c26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:38Z,use_quota=True,user_id='73f93aa021744b82b6e1e45fd088c79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed14fc56-f4df-4332-bd80-63824dbf9a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed14fc56-f4df-4332-bd80-63824dbf9a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f822be3-55cf-4430-8612-3683f9479e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f822be3-55cf-4430-8612-3683f9479e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873cbbb0-4a7c-457c-9a82-ccf757a3a471', 'volume_name': 'volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92365c2c-787c-4838-a1e9-00c4de23c17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92365c2c-787c-4838-a1e9-00c4de23c17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4add96-94b5-4929-a84e-3a44e33c66ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:37 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Volume 873cbbb0-4a7c-457c-9a82-ccf757a3a471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471', 'volume_size': 1} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1943673174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873cbbb0-4a7c-457c-9a82-ccf757a3a471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9585e5b674470abd7b6fbcbfb5c26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:38Z,use_quota=True,user_id='73f93aa021744b82b6e1e45fd088c79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Creating volume 873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:27:37 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:27:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:38 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 1073741824 Jul 08 18:27:38 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:39 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 1073741824" returned: 0 in 1.095s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:39 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 Jul 08 18:27:39 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:39 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471" returned: 0 in 0.677s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4add96-94b5-4929-a84e-3a44e33c66ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d49e27-83f9-46ce-98b8-ccca68380141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:39 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Volume volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 (873cbbb0-4a7c-457c-9a82-ccf757a3a471): created successfully Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d49e27-83f9-46ce-98b8-ccca68380141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Flow 'volume_create_manager' (531cd502-0cb1-48cb-9c5c-0d63550538e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:39 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-97bba30c-ed0a-4cd9-ad5d-64086481762d tempest-VolumesExtendTest-231768656 None] Created volume successfully. Jul 08 18:27:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Creating offline snapshot 57bffd70-fc51-4642-aa0a-2b3d565a724d of volume 873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:27:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7213c9ca-7438-46e2-99ef-f5977b82ba33]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:41 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 Jul 08 18:27:41 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:42 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471" returned: 0 in 1.139s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:42 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d 1G Jul 08 18:27:42 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:43 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d 1G" returned: 0 in 1.132s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:43 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d Jul 08 18:27:43 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:44 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d" returned: 0 in 1.054s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:44 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d is being set with open permissions: ugo+rw Jul 08 18:27:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:44 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d Jul 08 18:27:44 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:45 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d" returned: 0 in 0.855s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:45 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.info Jul 08 18:27:45 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:46 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.info" returned: 0 in 0.935s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:46 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.info is being set with open permissions: ugo+rw Jul 08 18:27:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:46 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.info Jul 08 18:27:46 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:46 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:27:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Flow 'volume_create_manager' (44674be1-57f8-4629-81df-6b47428aeef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:27:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5924b530-8635-42f7-888b-2c0ef2eaeb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5924b530-8635-42f7-888b-2c0ef2eaeb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bd6284-f365-4cf5-b69c-3faba589c8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7147a92e608449b59b54e36b1835cafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:47Z,use_quota=True,user_id='3aa8703635e1483eb5a982409684c892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a8b75e-b2b1-432c-bd3e-42629f78b384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a8b75e-b2b1-432c-bd3e-42629f78b384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d568b6b4-9605-4206-9552-8fd2374b08db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:27:47 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.info" returned: 0 in 0.969s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.226s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-627171c8-6448-4fe0-b030-67a89d2c485a tempest-VolumesExtendTest-231768656 None] Create snapshot completed successfully Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d568b6b4-9605-4206-9552-8fd2374b08db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82bd6284-f365-4cf5-b69c-3faba589c8f2', 'volume_name': 'volume-82bd6284-f365-4cf5-b69c-3faba589c8f2', 'volume_size': 1, 'image_id': '2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6de82e3500fbf9bdcaaedb0ca1c77c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7147a92e608449b59b54e36b1835cafb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e74da71908080d201b4a71306f013f4e6501b98f22befd04b8fba7e06e1d40f8143009b5e7e60bd190d5c2fbe6a43b6adad26494e646c5e79fe8b39a5ccd0e8a', 'id': '2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'created_at': datetime.datetime(2026, 7, 8, 16, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 27, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21/file', 'properties': {}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a62af48-d443-4d11-bae3-efc3ecef6d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a62af48-d443-4d11-bae3-efc3ecef6d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26e88a7-88eb-414b-9507-a8722515344f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:27:47 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Volume 82bd6284-f365-4cf5-b69c-3faba589c8f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82bd6284-f365-4cf5-b69c-3faba589c8f2', 'volume_size': 1, 'image_id': '2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6de82e3500fbf9bdcaaedb0ca1c77c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7147a92e608449b59b54e36b1835cafb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e74da71908080d201b4a71306f013f4e6501b98f22befd04b8fba7e06e1d40f8143009b5e7e60bd190d5c2fbe6a43b6adad26494e646c5e79fe8b39a5ccd0e8a', 'id': '2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'created_at': datetime.datetime(2026, 7, 8, 16, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 27, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21/file', 'properties': {}}, 'image_service': } Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Trying to clone 82bd6284-f365-4cf5-b69c-3faba589c8f2 from image 2c86f30b-b179-43ce-a6c9-0cdab018fe21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:27:47 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c214de-6d7a-41d6-9931-c48ed0b60e0a]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:48 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD Jul 08 18:27:48 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-673be644-3696-4545-9510-820765b13ae3 tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-673be644-3696-4545-9510-820765b13ae3 tempest-VolumesExtendTest-231768656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:48 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[634297fe-7312-431d-84ef-3e709a097db3]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-673be644-3696-4545-9510-820765b13ae3 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:48 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD" returned: 0 in 1.013s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:49 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 Jul 08 18:27:49 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:49 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD Jul 08 18:27:49 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:49 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD" returned: 1 in 0.954s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:27:49 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Temporary image 2c86f30b-b179-43ce-a6c9-0cdab018fe21 is fetched for user 3aa8703635e1483eb5a982409684c892. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:27:49 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-673be644-3696-4545-9510-820765b13ae3 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471" returned: 0 in 1.011s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-673be644-3696-4545-9510-820765b13ae3 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d 2G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:50 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad39dd2-1720-4170-b194-148efe65be04]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-673be644-3696-4545-9510-820765b13ae3 tempest-VolumesExtendTest-231768656 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d 2G" returned: 0 in 0.240s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-673be644-3696-4545-9510-820765b13ae3 tempest-VolumesExtendTest-231768656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.324s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-673be644-3696-4545-9510-820765b13ae3 tempest-VolumesExtendTest-231768656 None] Extend volume completed successfully. Jul 08 18:27:50 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD Jul 08 18:27:50 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:50 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD" returned: 0 in 0.813s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:51 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD Jul 08 18:27:51 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Acquiring lock "cinder-57bffd70-fc51-4642-aa0a-2b3d565a724d-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Lock "cinder-57bffd70-fc51-4642-aa0a-2b3d565a724d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Acquiring lock "cinder-quobyte-873cbbb0-4a7c-457c-9a82-ccf757a3a471" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Lock "cinder-quobyte-873cbbb0-4a7c-457c-9a82-ccf757a3a471" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Acquiring lock "cinder-quobyte-57bffd70-fc51-4642-aa0a-2b3d565a724d" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Lock "cinder-quobyte-57bffd70-fc51-4642-aa0a-2b3d565a724d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Deleting offline snapshot 57bffd70-fc51-4642-aa0a-2b3d565a724d of volume 873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] snapshot_file for this snap is: volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f2f3c8-ee60-4623-baf4-9262689e60b4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:51 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d Jul 08 18:27:51 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:51 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD" returned: 1 in 0.932s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bd6284-f365-4cf5-b69c-3faba589c8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7147a92e608449b59b54e36b1835cafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:27:47Z,use_quota=True,user_id='3aa8703635e1483eb5a982409684c892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Creating volume 82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:27:51 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:27:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:51 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 1073741824 Jul 08 18:27:51 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:52 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d" returned: 0 in 1.112s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:27:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbb0ba9-0112-4283-b2dd-3f12c9958fdb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:52 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 Jul 08 18:27:52 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:53 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 1073741824" returned: 0 in 1.280s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:53 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 Jul 08 18:27:53 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:53 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471" returned: 0 in 0.947s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:53 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d Jul 08 18:27:53 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:54 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2" returned: 0 in 0.854s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:27:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:54 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Attempting download of 2c86f30b-b179-43ce-a6c9-0cdab018fe21 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'metadata': {}}])) to volume 82bd6284-f365-4cf5-b69c-3faba589c8f2. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:27:54 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b8bf19-cad0-4f61-aaa7-11464ac0eec5]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c86f30b-b179-43ce-a6c9-0cdab018fe21_3h85ft0_ {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:54 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c86f30b-b179-43ce-a6c9-0cdab018fe21_3h85ft0_ Jul 08 18:27:54 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:54 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d" returned: 0 in 1.169s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:54 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d Jul 08 18:27:54 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:55 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c86f30b-b179-43ce-a6c9-0cdab018fe21_3h85ft0_" returned: 0 in 0.948s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c86f30b-b179-43ce-a6c9-0cdab018fe21_3h85ft0_ {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:55 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c86f30b-b179-43ce-a6c9-0cdab018fe21_3h85ft0_ Jul 08 18:27:55 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:55 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471.57bffd70-fc51-4642-aa0a-2b3d565a724d" returned: 0 in 1.144s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Lock "cinder-quobyte-57bffd70-fc51-4642-aa0a-2b3d565a724d" released by "_delete_snapshot" :: held 4.516s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Lock "cinder-quobyte-873cbbb0-4a7c-457c-9a82-ccf757a3a471" released by "delete_snapshot" :: held 4.555s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Created reservations ['16ae3b59-2b43-4d02-8c81-0e2936ca72b3', '77140d78-929c-4048-8aa3-b016c5dd520a', 'fd187df6-100c-436a-869e-c507542f1c68', '78686a59-43a0-4a81-8ff6-858e8b447ffc'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Delete snapshot completed successfully. Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7a254418-9905-496e-af05-4e6b224eefa2 tempest-VolumesExtendTest-231768656 None] Lock "cinder-57bffd70-fc51-4642-aa0a-2b3d565a724d-delete_snapshot" released by "delete_snapshot" :: held 4.866s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:56 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c86f30b-b179-43ce-a6c9-0cdab018fe21_3h85ft0_" returned: 1 in 1.101s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c86f30b-b179-43ce-a6c9-0cdab018fe21_3h85ft0_' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26a7a67-7811-4805-afd7-27ff9574b6d7]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:56 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD Jul 08 18:27:56 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Acquiring lock "cinder-873cbbb0-4a7c-457c-9a82-ccf757a3a471-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Lock "cinder-873cbbb0-4a7c-457c-9a82-ccf757a3a471-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Acquiring lock "cinder-quobyte-873cbbb0-4a7c-457c-9a82-ccf757a3a471" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Lock "cinder-quobyte-873cbbb0-4a7c-457c-9a82-ccf757a3a471" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c00eb15-ad7a-4b92-a9e9-1b2fa249ba68]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:27:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:57 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 Jul 08 18:27:57 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:57 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD" returned: 0 in 0.925s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:57 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD Jul 08 18:27:57 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:58 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471" returned: 0 in 1.203s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:58 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD" returned: 1 in 0.991s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:27:58 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] 2c86f30b-b179-43ce-a6c9-0cdab018fe21 was raw, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:27:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:58 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471 Jul 08 18:27:58 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:58 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 Jul 08 18:27:58 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:59 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-873cbbb0-4a7c-457c-9a82-ccf757a3a471" returned: 0 in 0.966s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Lock "cinder-quobyte-873cbbb0-4a7c-457c-9a82-ccf757a3a471" released by "delete_volume" :: held 2.261s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:27:59 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2" returned: 0 in 0.994s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c86f30b-b179-43ce-a6c9-0cdab018fe21_o5pbi8l2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:27:59 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:59 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 1G Jul 08 18:27:59 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Created reservations ['bc097c01-72c0-4e37-a098-3b5fa6e45f27', 'ae5a97e8-1588-4f3e-8397-ab0e6fb3272f', '64d021df-a2f3-4455-9e93-406e65fcaf3f', '3668e1cb-fb5e-453f-b9df-3eecc09aa83c'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:27:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:27:59 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:27:59 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:00 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 1G" returned: 0 in 1.019s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:00 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[882896ce-e202-42d1-848e-5cfa43c59603]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.934s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:00 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Deleted volume successfully. Jul 08 18:28:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4d9fb9ee-5811-4873-b10b-6d934baf6a6b tempest-VolumesExtendTest-231768656 None] Lock "cinder-873cbbb0-4a7c-457c-9a82-ccf757a3a471-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:00 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 Jul 08 18:28:00 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:01 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2" returned: 0 in 0.972s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:01 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 Jul 08 18:28:01 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:02 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2" returned: 1 in 0.889s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Downloaded image 2c86f30b-b179-43ce-a6c9-0cdab018fe21 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'metadata': {}}])) to volume 82bd6284-f365-4cf5-b69c-3faba589c8f2 successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Temporary image 2c86f30b-b179-43ce-a6c9-0cdab018fe21 for user 3aa8703635e1483eb5a982409684c892 is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Marking volume 82bd6284-f365-4cf5-b69c-3faba589c8f2 as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Copying metadata from image 2c86f30b-b179-43ce-a6c9-0cdab018fe21 to 82bd6284-f365-4cf5-b69c-3faba589c8f2. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Creating volume glance metadata for volume 82bd6284-f365-4cf5-b69c-3faba589c8f2 backed by image 2c86f30b-b179-43ce-a6c9-0cdab018fe21 with: {'image_id': '2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6de82e3500fbf9bdcaaedb0ca1c77c7b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26e88a7-88eb-414b-9507-a8722515344f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bd6284-f365-4cf5-b69c-3faba589c8f2', 'volume_size': 1, 'image_id': '2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6de82e3500fbf9bdcaaedb0ca1c77c7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7147a92e608449b59b54e36b1835cafb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e74da71908080d201b4a71306f013f4e6501b98f22befd04b8fba7e06e1d40f8143009b5e7e60bd190d5c2fbe6a43b6adad26494e646c5e79fe8b39a5ccd0e8a', 'id': '2c86f30b-b179-43ce-a6c9-0cdab018fe21', 'created_at': datetime.datetime(2026, 7, 8, 16, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 27, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c86f30b-b179-43ce-a6c9-0cdab018fe21/file', 'properties': {}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0708a5eb-9d24-4c04-85c8-4230095cf649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:02 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Volume volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 (82bd6284-f365-4cf5-b69c-3faba589c8f2): created successfully Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0708a5eb-9d24-4c04-85c8-4230095cf649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Flow 'volume_create_manager' (44674be1-57f8-4629-81df-6b47428aeef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:02 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-28431e74-e138-4d12-a3e9-783cf19cd637 tempest-VolumeImageDependencyTests-480993295 None] Created volume successfully. Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:02 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:28:02 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Acquiring lock "cinder-82bd6284-f365-4cf5-b69c-3faba589c8f2-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Lock "cinder-82bd6284-f365-4cf5-b69c-3faba589c8f2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Acquiring lock "cinder-quobyte-82bd6284-f365-4cf5-b69c-3faba589c8f2" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Lock "cinder-quobyte-82bd6284-f365-4cf5-b69c-3faba589c8f2" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a414115-6ccd-4c27-84aa-a09325fb0c80]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:03 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 Jul 08 18:28:03 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:03 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.030s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:28:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:28:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:28:04 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2" returned: 0 in 1.274s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:04 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 Jul 08 18:28:04 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:04 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:28:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Flow 'volume_create_manager' (0d34855c-2df8-4d51-a63d-e5ba3372303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877b07e3-3c62-4b8d-80aa-8f33cdbe7342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877b07e3-3c62-4b8d-80aa-8f33cdbe7342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1869092246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e83603f-08a7-404c-8d38-d003e9c1f1b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d37d06ac743a43989e5a347b2d56d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:05Z,use_quota=True,user_id='c7e97a8f84d744b0b410050c8a9486b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae28ef36-6a88-409f-b137-4e650365151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae28ef36-6a88-409f-b137-4e650365151d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471e63a7-a86d-4f4b-a816-d59203a6a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471e63a7-a86d-4f4b-a816-d59203a6a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e83603f-08a7-404c-8d38-d003e9c1f1b6', 'volume_name': 'volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe58d147-c052-40ad-8a14-2617e20d921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe58d147-c052-40ad-8a14-2617e20d921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95334d86-6e31-4486-8c3b-5d47cd7173aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Volume 3e83603f-08a7-404c-8d38-d003e9c1f1b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6', 'volume_size': 1} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1869092246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e83603f-08a7-404c-8d38-d003e9c1f1b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d37d06ac743a43989e5a347b2d56d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:05Z,use_quota=True,user_id='c7e97a8f84d744b0b410050c8a9486b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Creating volume 3e83603f-08a7-404c-8d38-d003e9c1f1b6 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:28:05 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:05 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2" returned: 1 in 1.049s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:28:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:05 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 1073741824 Jul 08 18:28:05 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:05 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2 Jul 08 18:28:05 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:06 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-82bd6284-f365-4cf5-b69c-3faba589c8f2" returned: 0 in 0.912s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Lock "cinder-quobyte-82bd6284-f365-4cf5-b69c-3faba589c8f2" released by "delete_volume" :: held 3.356s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Created reservations ['bdcf0dfc-9832-4e6b-a2f7-e62cfab37433', '8b96ddc1-b31c-46f5-aec5-1667b4f20f7c', 'b44afdca-13b4-48c1-974b-7c35b3230d14', '85407408-8417-417c-ae86-02c9bcaef625'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:06 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:28:06 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:06 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 1073741824" returned: 0 in 1.340s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:06 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 Jul 08 18:28:06 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:07 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.785s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:07 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Deleted volume successfully. Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-41ba1bc8-bc06-436b-a690-8ae807a12260 tempest-VolumeImageDependencyTests-480993295 None] Lock "cinder-82bd6284-f365-4cf5-b69c-3faba589c8f2-delete_volume" released by "delete_volume" :: held 4.506s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:07 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6" returned: 0 in 1.003s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] <== create_volume: return (2403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.407s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95334d86-6e31-4486-8c3b-5d47cd7173aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74d5c6f-34cc-46f0-bc87-a465b9fe5640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:07 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Volume volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 (3e83603f-08a7-404c-8d38-d003e9c1f1b6): created successfully Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74d5c6f-34cc-46f0-bc87-a465b9fe5640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Flow 'volume_create_manager' (0d34855c-2df8-4d51-a63d-e5ba3372303d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:07 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f27febc6-68f4-48b3-a419-f671bbc15314 tempest-VolumesListTestJSON-889273898 None] Created volume successfully. Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Flow 'volume_create_manager' (5774c0ff-dd5a-43f6-88b4-b30d3934e051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33adb015-d86e-4630-812d-a950b588df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33adb015-d86e-4630-812d-a950b588df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-329752443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce8c7e7-d2e0-4387-a97d-a88a2334b11e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d37d06ac743a43989e5a347b2d56d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:09Z,use_quota=True,user_id='c7e97a8f84d744b0b410050c8a9486b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3657163b-37bf-4c3c-9716-061c53671629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3657163b-37bf-4c3c-9716-061c53671629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4456643-5302-4f1b-b22e-eec022b35fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4456643-5302-4f1b-b22e-eec022b35fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce8c7e7-d2e0-4387-a97d-a88a2334b11e', 'volume_name': 'volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277d0500-6131-43a3-882c-a3feefbc1c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277d0500-6131-43a3-882c-a3feefbc1c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c049524d-5015-4ea2-90f0-2635a82ee05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:08 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Volume 8ce8c7e7-d2e0-4387-a97d-a88a2334b11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e', 'volume_size': 1} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-329752443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce8c7e7-d2e0-4387-a97d-a88a2334b11e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d37d06ac743a43989e5a347b2d56d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:09Z,use_quota=True,user_id='c7e97a8f84d744b0b410050c8a9486b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Creating volume 8ce8c7e7-d2e0-4387-a97d-a88a2334b11e {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:28:08 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:28:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:09 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e 1073741824 Jul 08 18:28:09 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:10 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e 1073741824" returned: 0 in 1.468s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:10 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e Jul 08 18:28:10 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:11 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e" returned: 0 in 0.960s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] <== create_volume: return (2494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:28:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c049524d-5015-4ea2-90f0-2635a82ee05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fa3a7e-894d-426f-8281-f1e58fdb09aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:11 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Volume volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e (8ce8c7e7-d2e0-4387-a97d-a88a2334b11e): created successfully Jul 08 18:28:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fa3a7e-894d-426f-8281-f1e58fdb09aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Flow 'volume_create_manager' (5774c0ff-dd5a-43f6-88b4-b30d3934e051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6e247e9e-d420-4da1-b94f-422478bda44f tempest-VolumesListTestJSON-889273898 None] Created volume successfully. Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Flow 'volume_create_manager' (9e37282d-c1e1-4eb8-ae10-93a3557534ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd0e122-a25b-4549-89aa-80a8f1bbc0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd0e122-a25b-4549-89aa-80a8f1bbc0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-126323617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44dccad-631b-4b6b-997c-de41b29e290a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04707b804a747448a68b2dabd678528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:12Z,use_quota=True,user_id='c559707fed7a412bbc1e7057af0239a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2206dcbb-7129-4202-bafe-4a6307ff805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2206dcbb-7129-4202-bafe-4a6307ff805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426cf8af-42ce-40a6-9b87-a4dc7cef8835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426cf8af-42ce-40a6-9b87-a4dc7cef8835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44dccad-631b-4b6b-997c-de41b29e290a', 'volume_name': 'volume-b44dccad-631b-4b6b-997c-de41b29e290a', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5a0325-9d23-48a4-b8fe-5ce75c159edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5a0325-9d23-48a4-b8fe-5ce75c159edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b770ad97-4516-4cf4-943a-1099c7cefa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Volume b44dccad-631b-4b6b-997c-de41b29e290a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44dccad-631b-4b6b-997c-de41b29e290a', 'volume_size': 1} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-126323617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44dccad-631b-4b6b-997c-de41b29e290a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04707b804a747448a68b2dabd678528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:12Z,use_quota=True,user_id='c559707fed7a412bbc1e7057af0239a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Creating volume b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:28:12 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:12 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a 1073741824 Jul 08 18:28:12 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Flow 'volume_create_manager' (3e8c4c11-8f77-40e1-8896-c0c860d4a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3326e9-f415-4b7b-a158-d36c3bcdc5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3326e9-f415-4b7b-a158-d36c3bcdc5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1579642884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fe5f30-d538-4996-b28b-669002dd13ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d37d06ac743a43989e5a347b2d56d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:13Z,use_quota=True,user_id='c7e97a8f84d744b0b410050c8a9486b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba10e5c5-d510-4245-8c0f-e3431bd88189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba10e5c5-d510-4245-8c0f-e3431bd88189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53819ae0-93cb-4b10-b009-0b17d756b054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53819ae0-93cb-4b10-b009-0b17d756b054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fe5f30-d538-4996-b28b-669002dd13ce', 'volume_name': 'volume-80fe5f30-d538-4996-b28b-669002dd13ce', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b805b7c-14ad-4996-aa93-a6931e815882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b805b7c-14ad-4996-aa93-a6931e815882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b28e54-670c-433c-91a0-d3c80f7d4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Volume 80fe5f30-d538-4996-b28b-669002dd13ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fe5f30-d538-4996-b28b-669002dd13ce', 'volume_size': 1} Jul 08 18:28:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:13 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a 1073741824" returned: 0 in 1.259s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:13 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a Jul 08 18:28:13 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:14 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a" returned: 0 in 0.797s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1579642884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fe5f30-d538-4996-b28b-669002dd13ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d37d06ac743a43989e5a347b2d56d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:13Z,use_quota=True,user_id='c7e97a8f84d744b0b410050c8a9486b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Creating volume 80fe5f30-d538-4996-b28b-669002dd13ce {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:28:14 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b770ad97-4516-4cf4-943a-1099c7cefa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44dccad-631b-4b6b-997c-de41b29e290a', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c61df75-a87c-440a-a75b-42bb8d3e8efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:14 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce 1073741824 Jul 08 18:28:14 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:14 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Volume volume-b44dccad-631b-4b6b-997c-de41b29e290a (b44dccad-631b-4b6b-997c-de41b29e290a): created successfully Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c61df75-a87c-440a-a75b-42bb8d3e8efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Flow 'volume_create_manager' (9e37282d-c1e1-4eb8-ae10-93a3557534ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0572e9ff-a2f7-4b24-a15c-082b867203a1 tempest-SnapshotDependencyTests-525454260 None] Created volume successfully. Jul 08 18:28:15 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce 1073741824" returned: 0 in 1.012s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:15 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce Jul 08 18:28:15 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:16 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce" returned: 0 in 0.901s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.527s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b28e54-670c-433c-91a0-d3c80f7d4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fe5f30-d538-4996-b28b-669002dd13ce', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2959851-cb4b-4d6a-8f12-e94698be8287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Creating offline snapshot 74bbff54-0e39-4392-8a7b-a84996ef7523 of volume b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:28:16 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Volume volume-80fe5f30-d538-4996-b28b-669002dd13ce (80fe5f30-d538-4996-b28b-669002dd13ce): created successfully Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2959851-cb4b-4d6a-8f12-e94698be8287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Flow 'volume_create_manager' (3e8c4c11-8f77-40e1-8896-c0c860d4a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a72f9-632e-453d-8b1b-2028678a1b8c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:16 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8333b2f7-8114-4092-ab2c-397a4c72cf77 tempest-VolumesListTestJSON-889273898 None] Created volume successfully. Jul 08 18:28:16 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a Jul 08 18:28:16 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:17 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a" returned: 0 in 1.181s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:17 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 1G Jul 08 18:28:17 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:19 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 1G" returned: 0 in 1.330s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44dccad-631b-4b6b-997c-de41b29e290a -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:19 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44dccad-631b-4b6b-997c-de41b29e290a -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 Jul 08 18:28:19 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:19 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44dccad-631b-4b6b-997c-de41b29e290a -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523" returned: 0 in 0.854s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:19 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 is being set with open permissions: ugo+rw Jul 08 18:28:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "cinder-80fe5f30-d538-4996-b28b-669002dd13ce-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:19 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 Jul 08 18:28:19 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Lock "cinder-80fe5f30-d538-4996-b28b-669002dd13ce-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "cinder-quobyte-80fe5f30-d538-4996-b28b-669002dd13ce" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Lock "cinder-quobyte-80fe5f30-d538-4996-b28b-669002dd13ce" acquired by "delete_volume" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:20 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[01506b56-6c92-4942-92e4-b287df687286]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:20 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce Jul 08 18:28:20 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:20 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523" returned: 0 in 0.765s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:20 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.info Jul 08 18:28:20 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:21 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce" returned: 0 in 1.044s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:21 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce Jul 08 18:28:21 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:21 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.info" returned: 0 in 0.841s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:21 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.info is being set with open permissions: ugo+rw Jul 08 18:28:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:21 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.info Jul 08 18:28:21 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:21 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-80fe5f30-d538-4996-b28b-669002dd13ce" returned: 0 in 0.767s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Lock "cinder-quobyte-80fe5f30-d538-4996-b28b-669002dd13ce" released by "delete_volume" :: held 1.866s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:21 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Created reservations ['b6a1f32b-482b-4669-8fcc-0621ade21c3c', '687079cd-c73c-462a-9e81-dc1fdcf2091a', 'bc8e6739-e594-4784-8f84-303857659387', '318d21c4-87e7-49f0-91c3-9b1042cb3c64'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:22 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:28:22 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:22 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.info" returned: 0 in 0.757s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.897s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Acquiring lock "cinder-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:22 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-19c2b128-7f9b-45ab-bdd2-4b4b59099768 tempest-SnapshotDependencyTests-525454260 None] Create snapshot completed successfully Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Lock "cinder-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Acquiring lock "cinder-quobyte-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Lock "cinder-quobyte-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdf7de4-78c7-4bc0-b552-c9d8367e624f]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:22 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e Jul 08 18:28:22 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:23 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.092s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:23 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Deleted volume successfully. Jul 08 18:28:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-638d9644-9f10-494d-9923-01633ea129b3 tempest-VolumesListTestJSON-889273898 None] Lock "cinder-80fe5f30-d538-4996-b28b-669002dd13ce-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:24 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e" returned: 0 in 1.405s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:24 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e Jul 08 18:28:24 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Flow 'volume_create_manager' (637bc50f-6433-4bbc-a5eb-ed39b6240d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcced812-a3dc-457a-a560-18d14bbc00e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcced812-a3dc-457a-a560-18d14bbc00e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1340257d-6d61-4351-a7e1-2037079e3c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04707b804a747448a68b2dabd678528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74bbff54-0e39-4392-8a7b-a84996ef7523,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:24Z,use_quota=True,user_id='c559707fed7a412bbc1e7057af0239a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda487bc-1f5c-45eb-b944-3b2e1067c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda487bc-1f5c-45eb-b944-3b2e1067c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b85b5a4-0832-4266-9732-2d5865705a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b85b5a4-0832-4266-9732-2d5865705a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1340257d-6d61-4351-a7e1-2037079e3c07', 'volume_name': 'volume-1340257d-6d61-4351-a7e1-2037079e3c07', 'volume_size': 1, 'snapshot_id': '74bbff54-0e39-4392-8a7b-a84996ef7523'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659b65c0-674a-4b72-9f32-018005a71b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659b65c0-674a-4b72-9f32-018005a71b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dadf9c2-ce58-41b1-982b-423e89646366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:24 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Volume 1340257d-6d61-4351-a7e1-2037079e3c07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1340257d-6d61-4351-a7e1-2037079e3c07', 'volume_size': 1, 'snapshot_id': '74bbff54-0e39-4392-8a7b-a84996ef7523'} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-quobyte-74bbff54-0e39-4392-8a7b-a84996ef7523-1340257d-6d61-4351-a7e1-2037079e3c07" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-74bbff54-0e39-4392-8a7b-a84996ef7523-1340257d-6d61-4351-a7e1-2037079e3c07" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Creating volume 1340257d-6d61-4351-a7e1-2037079e3c07 from snapshot 74bbff54-0e39-4392-8a7b-a84996ef7523 {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-quobyte-1340257d-6d61-4351-a7e1-2037079e3c07" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-1340257d-6d61-4351-a7e1-2037079e3c07" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] snapshot: 74bbff54-0e39-4392-8a7b-a84996ef7523, volume: 1340257d-6d61-4351-a7e1-2037079e3c07, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d5a45-66cb-441c-aba8-36e6e75f928a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:24 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 Jul 08 18:28:24 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:24 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e" returned: 0 in 0.922s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Lock "cinder-quobyte-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e" released by "delete_volume" :: held 2.414s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Created reservations ['510fca87-8767-4e2a-a6d9-c35bddcf1400', '5c0f57db-a2fd-4c09-a9cd-65c5c95207fa', '3252953d-ad18-4ed5-838b-2481e92935aa', '6b5e5ad8-d9b9-4289-9495-ae9a958278f8'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:25 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:28:25 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:25 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523" returned: 0 in 0.851s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44dccad-631b-4b6b-997c-de41b29e290a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5bd0ad-e008-4358-a851-047302b9c810]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:25 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a Jul 08 18:28:25 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "cinder-3e83603f-08a7-404c-8d38-d003e9c1f1b6-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:25 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.839s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:25 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:25 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Deleted volume successfully. Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Lock "cinder-3e83603f-08a7-404c-8d38-d003e9c1f1b6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4c4d3a41-9b92-410e-9779-330a53c8b6ee tempest-VolumesListTestJSON-889273898 None] Lock "cinder-8ce8c7e7-d2e0-4387-a97d-a88a2334b11e-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "cinder-quobyte-3e83603f-08a7-404c-8d38-d003e9c1f1b6" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Lock "cinder-quobyte-3e83603f-08a7-404c-8d38-d003e9c1f1b6" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b1617-fdf2-4163-8331-9c67061bedd8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:26 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 Jul 08 18:28:26 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:26 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a" returned: 0 in 1.056s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:28:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:26 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 Jul 08 18:28:26 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:27 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6" returned: 0 in 1.152s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:27 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6 Jul 08 18:28:27 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:28 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3e83603f-08a7-404c-8d38-d003e9c1f1b6" returned: 0 in 1.456s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Lock "cinder-quobyte-3e83603f-08a7-404c-8d38-d003e9c1f1b6" released by "delete_volume" :: held 2.670s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:29 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Created reservations ['c22835cd-cc14-4db1-92b6-39b7cdac7391', 'bd5cdbf0-7a85-41b0-9e51-1e729a0632ac', 'f2d58c2c-2333-4419-aaa3-92f13654f263', 'dbf22442-44fb-4190-87ad-c275209e96ed'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:28:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:29 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:28:29 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:31 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 2.302s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:31 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Deleted volume successfully. Jul 08 18:28:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-8a72cfd9-93dd-425e-9ad2-00aeefbf1e78 tempest-VolumesListTestJSON-889273898 None] Lock "cinder-3e83603f-08a7-404c-8d38-d003e9c1f1b6-delete_volume" released by "delete_volume" :: held 5.649s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:34 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07" returned: 0 in 7.884s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:34 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b3bcf4-864b-44fb-9fe5-62c54e8983c5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:34 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a Jul 08 18:28:34 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:35 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a" returned: 0 in 1.023s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:35 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a, size 1024.00 MB, duration 7.88 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:28:35 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Converted 1024.00 MB image at 129.87 MB/s Jul 08 18:28:35 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 is being set with open permissions: ugo+rw Jul 08 18:28:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:35 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 Jul 08 18:28:35 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:36 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07" returned: 0 in 0.783s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-1340257d-6d61-4351-a7e1-2037079e3c07" released by "_copy_volume_from_snapshot" :: held 11.720s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-74bbff54-0e39-4392-8a7b-a84996ef7523-1340257d-6d61-4351-a7e1-2037079e3c07" released by "_create_volume_from_snapshot" :: held 11.763s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.784s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=81,cinder:UPDATE=115,cinder:INSERT=33,cinder:DELETE=6 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=87,cinder:INSERT=28,cinder:UPDATE=107,cinder:DELETE=11 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dadf9c2-ce58-41b1-982b-423e89646366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1340257d-6d61-4351-a7e1-2037079e3c07', 'volume_size': 1, 'snapshot_id': '74bbff54-0e39-4392-8a7b-a84996ef7523'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9feff44-c221-4101-9571-d5a727feab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:36 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Volume volume-1340257d-6d61-4351-a7e1-2037079e3c07 (1340257d-6d61-4351-a7e1-2037079e3c07): created successfully Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9feff44-c221-4101-9571-d5a727feab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Flow 'volume_create_manager' (637bc50f-6433-4bbc-a5eb-ed39b6240d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-01af4a60-c120-4217-be13-c1f04265514e tempest-SnapshotDependencyTests-525454260 None] Created volume successfully. Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Flow 'volume_create_manager' (840d0502-2237-42d6-a18b-6ef8914c7d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c4f8c6-fb66-4ff8-9cea-b7ac8bcc1cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c4f8c6-fb66-4ff8-9cea-b7ac8bcc1cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2065038825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4fd296-517a-43e1-b2d9-7cae415ca51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ca0ab919654fee88e802ca46fc4ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:37Z,use_quota=True,user_id='b48120120574407696714fb3cb0dd325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709cdbd2-52b4-437a-92ad-62b10ac94d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709cdbd2-52b4-437a-92ad-62b10ac94d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdde6e40-9cbb-4da5-b487-af20dbac1cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdde6e40-9cbb-4da5-b487-af20dbac1cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4fd296-517a-43e1-b2d9-7cae415ca51c', 'volume_name': 'volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25a45c2-9183-4473-a437-d23f724fea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25a45c2-9183-4473-a437-d23f724fea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e66f6aa-a7ce-4419-99d5-9bac36086ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:36 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Volume 6c4fd296-517a-43e1-b2d9-7cae415ca51c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c', 'volume_size': 1} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2065038825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4fd296-517a-43e1-b2d9-7cae415ca51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ca0ab919654fee88e802ca46fc4ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:37Z,use_quota=True,user_id='b48120120574407696714fb3cb0dd325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Creating volume 6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:28:36 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:28:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:36 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c 1073741824 Jul 08 18:28:36 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-74bbff54-0e39-4392-8a7b-a84996ef7523-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-74bbff54-0e39-4392-8a7b-a84996ef7523-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-quobyte-b44dccad-631b-4b6b-997c-de41b29e290a" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-b44dccad-631b-4b6b-997c-de41b29e290a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-quobyte-74bbff54-0e39-4392-8a7b-a84996ef7523" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-74bbff54-0e39-4392-8a7b-a84996ef7523" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Deleting offline snapshot 74bbff54-0e39-4392-8a7b-a84996ef7523 of volume b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] snapshot_file for this snap is: volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd25092-65f5-4df3-a7cb-33fe47a6ce70]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:37 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 Jul 08 18:28:37 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:37 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c 1073741824" returned: 0 in 0.968s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:37 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c Jul 08 18:28:37 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:38 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523" returned: 0 in 0.869s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44dccad-631b-4b6b-997c-de41b29e290a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9a796d-3f7f-4dfc-b5ef-faa803785ce2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:38 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c" returned: 0 in 0.669s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:38 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a Jul 08 18:28:38 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e66f6aa-a7ce-4419-99d5-9bac36086ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31b010a-eaa1-41b2-8b31-a67382667e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Volume volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c (6c4fd296-517a-43e1-b2d9-7cae415ca51c): created successfully Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31b010a-eaa1-41b2-8b31-a67382667e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Flow 'volume_create_manager' (840d0502-2237-42d6-a18b-6ef8914c7d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-bde4baea-a8cc-4b12-8fff-7b5154bc7dd4 tempest-VolumesSnapshotListTestJSON-119818655 None] Created volume successfully. Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Creating offline snapshot 54144041-5451-4619-9566-d7cb462e6654 of volume 6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06dd07f-b23f-416c-82fc-ed970f2bd9eb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:38 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c Jul 08 18:28:38 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:38 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a" returned: 0 in 0.761s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:39 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 Jul 08 18:28:39 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:39 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c" returned: 0 in 0.762s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:39 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 1G Jul 08 18:28:39 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:39 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523" returned: 0 in 0.707s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:39 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523 Jul 08 18:28:39 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:40 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a.74bbff54-0e39-4392-8a7b-a84996ef7523" returned: 0 in 0.644s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:40 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 1G" returned: 0 in 0.820s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-74bbff54-0e39-4392-8a7b-a84996ef7523" released by "_delete_snapshot" :: held 3.103s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-b44dccad-631b-4b6b-997c-de41b29e290a" released by "delete_snapshot" :: held 3.135s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:40 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 Jul 08 18:28:40 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:40 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Created reservations ['073cd6e8-0fd1-49ea-840e-0573f1dcc813', '16435e3d-a903-4c3d-9bdc-d39b7e7b861d', '50bcb25f-90d5-439b-9320-02b6e573eeba', '2a85c815-c176-435a-b6a5-10f202505853'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:28:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Delete snapshot completed successfully. Jul 08 18:28:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e88e2906-3871-40c9-a4e7-2dedcd2bb3e1 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-74bbff54-0e39-4392-8a7b-a84996ef7523-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:41 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654" returned: 0 in 0.709s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:41 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 is being set with open permissions: ugo+rw Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:41 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 Jul 08 18:28:41 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-b44dccad-631b-4b6b-997c-de41b29e290a-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-b44dccad-631b-4b6b-997c-de41b29e290a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-quobyte-b44dccad-631b-4b6b-997c-de41b29e290a" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-b44dccad-631b-4b6b-997c-de41b29e290a" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7065a471-ae2f-4ba6-a14b-6a595f09a385]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:41 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a Jul 08 18:28:41 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:41 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654" returned: 0 in 0.716s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:41 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.info Jul 08 18:28:41 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:42 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a" returned: 0 in 0.823s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:42 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a Jul 08 18:28:42 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:42 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.info" returned: 0 in 0.682s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:42 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.info is being set with open permissions: ugo+rw Jul 08 18:28:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:42 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.info Jul 08 18:28:42 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:43 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b44dccad-631b-4b6b-997c-de41b29e290a" returned: 0 in 0.695s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-b44dccad-631b-4b6b-997c-de41b29e290a" released by "delete_volume" :: held 1.594s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Created reservations ['094ad1bc-228b-46cf-bc2d-fcd163f66578', 'bf80c78a-27a7-4684-9ea5-20ae4f02b9a9', '829e6ff2-1091-4830-9661-44ae8e53d372', '90c727c7-ec85-456d-926c-10d9dabbcd8b'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:43 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.info" returned: 0 in 0.755s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:43 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:28:43 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.548s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-848d3c87-9cbc-4f64-bb6d-aca4a607ebc0 tempest-VolumesSnapshotListTestJSON-119818655 None] Create snapshot completed successfully Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-1340257d-6d61-4351-a7e1-2037079e3c07-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-1340257d-6d61-4351-a7e1-2037079e3c07-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "cinder-quobyte-1340257d-6d61-4351-a7e1-2037079e3c07" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-1340257d-6d61-4351-a7e1-2037079e3c07" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d7a499-a797-4c75-94ab-3394d3fd720e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:43 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 Jul 08 18:28:43 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:43 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.711s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:43 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Deleted volume successfully. Jul 08 18:28:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-518889e9-bb27-4b5e-9fb1-032ae842fe91 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-b44dccad-631b-4b6b-997c-de41b29e290a-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Creating offline snapshot 884f1980-9fc3-456a-a3a6-4acb2745f0f4 of volume 6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:28:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e61322-8a3f-471c-bb65-3ce63d61fb4b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:44 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 Jul 08 18:28:44 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:44 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07" returned: 0 in 0.851s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:44 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07 Jul 08 18:28:44 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:45 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654" returned: 0 in 0.867s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:45 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 1G Jul 08 18:28:45 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:45 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1340257d-6d61-4351-a7e1-2037079e3c07" returned: 0 in 0.782s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-quobyte-1340257d-6d61-4351-a7e1-2037079e3c07" released by "delete_volume" :: held 1.696s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Created reservations ['331a8507-79e1-4bfd-9221-c39db6e2e820', 'e0757b58-1bcc-4596-aa01-15c94bc90cf0', 'b4bfd6ee-ecf1-476f-976a-d26b839f777a', '34c796c6-4e09-4f6e-b90b-b18b85950c66'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:45 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:28:45 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:46 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 1G" returned: 0 in 1.043s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:46 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 Jul 08 18:28:46 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:46 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.798s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:46 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:28:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Deleted volume successfully. Jul 08 18:28:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-16633352-f0b0-47b3-b6cf-dbd2a25a5ee7 tempest-SnapshotDependencyTests-525454260 None] Lock "cinder-1340257d-6d61-4351-a7e1-2037079e3c07-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:47 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4" returned: 0 in 0.869s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:47 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 is being set with open permissions: ugo+rw Jul 08 18:28:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:47 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 Jul 08 18:28:47 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:47 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4" returned: 0 in 0.717s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.645s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e48fd894-7216-4975-9f05-4a0a43ef1648 tempest-VolumesSnapshotListTestJSON-119818655 None] Create snapshot completed successfully Jul 08 18:28:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Creating offline snapshot ddb77233-7970-4ea1-a1d5-78691be182df of volume 6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:28:48 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[276e4a52-4558-4445-9181-62dfa0d42279]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:48 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 Jul 08 18:28:48 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:49 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4" returned: 0 in 0.923s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:28:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:49 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df 1G Jul 08 18:28:49 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:50 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df 1G" returned: 0 in 1.018s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:50 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df Jul 08 18:28:50 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:51 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df" returned: 0 in 0.843s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:51 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df is being set with open permissions: ugo+rw Jul 08 18:28:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:51 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df Jul 08 18:28:51 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Flow 'volume_create_manager' (07f48865-14bd-4331-8904-021f42f493e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c437d5-8070-412f-ae60-c0103a687df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c437d5-8070-412f-ae60-c0103a687df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1464577443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a1e7fa-f2cc-4dcc-9026-0b7edb776100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ea858e7efe4a13a357b0cccac77d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:52Z,use_quota=True,user_id='89fd096769414f45b9e314d7fe2e1469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a4c347-8afa-43c9-a1fc-bf2f17ca80e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a4c347-8afa-43c9-a1fc-bf2f17ca80e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48acbb19-90e5-4c75-b7ca-ed318f6afb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48acbb19-90e5-4c75-b7ca-ed318f6afb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a1e7fa-f2cc-4dcc-9026-0b7edb776100', 'volume_name': 'volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90fbeeb-d028-4663-b82f-a38b5d3ca038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90fbeeb-d028-4663-b82f-a38b5d3ca038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aee215e-ba26-4379-9a65-e0c378065544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:52 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Volume 40a1e7fa-f2cc-4dcc-9026-0b7edb776100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100', 'volume_size': 1} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:52 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df" returned: 0 in 0.802s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.701s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1464577443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a1e7fa-f2cc-4dcc-9026-0b7edb776100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ea858e7efe4a13a357b0cccac77d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:28:52Z,use_quota=True,user_id='89fd096769414f45b9e314d7fe2e1469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Creating volume 40a1e7fa-f2cc-4dcc-9026-0b7edb776100 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:28:52 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:28:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:52 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 1073741824 Jul 08 18:28:52 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2c63daca-9f7a-46e1-857e-ca7f8ba4962d tempest-VolumesSnapshotListTestJSON-119818655 None] Create snapshot completed successfully Jul 08 18:28:53 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 1073741824" returned: 0 in 1.054s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:53 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 Jul 08 18:28:53 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-ddb77233-7970-4ea1-a1d5-78691be182df-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-ddb77233-7970-4ea1-a1d5-78691be182df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-quobyte-ddb77233-7970-4ea1-a1d5-78691be182df" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-ddb77233-7970-4ea1-a1d5-78691be182df" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Deleting offline snapshot ddb77233-7970-4ea1-a1d5-78691be182df of volume 6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] snapshot_file for this snap is: volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c91dfba-2f30-4cd5-89f9-7d6473040139]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:54 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df Jul 08 18:28:54 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:54 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100" returned: 0 in 0.809s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aee215e-ba26-4379-9a65-e0c378065544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb177578-4baa-4bd1-810b-32869522701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:28:54 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Volume volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 (40a1e7fa-f2cc-4dcc-9026-0b7edb776100): created successfully Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb177578-4baa-4bd1-810b-32869522701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Flow 'volume_create_manager' (07f48865-14bd-4331-8904-021f42f493e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:28:54 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a43e14f0-2df7-48f6-b45a-d4b4c530069f tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Created volume successfully. Jul 08 18:28:54 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df" returned: 0 in 0.910s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[14602659-b0a7-40cc-8680-dfc764900d8a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:54 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 Jul 08 18:28:54 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:55 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4" returned: 0 in 0.854s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:28:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:55 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df Jul 08 18:28:55 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:56 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df" returned: 0 in 0.923s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:56 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df Jul 08 18:28:56 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:57 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.ddb77233-7970-4ea1-a1d5-78691be182df" returned: 0 in 0.683s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-ddb77233-7970-4ea1-a1d5-78691be182df" released by "_delete_snapshot" :: held 3.481s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" released by "delete_snapshot" :: held 3.506s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:57 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Created reservations ['9e0862df-7953-4a17-b3ee-3f758031d212', '73798f3d-251f-4347-bbe7-25fe2193d667', 'a80ce612-3887-4898-afd0-57c13ccd7cd9', 'b2f81def-4f10-4cd3-85c1-438e6fe1d93a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:28:57 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Delete snapshot completed successfully. Jul 08 18:28:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-88c2aa42-ee1e-48d5-aba5-adf5e65b16d1 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-ddb77233-7970-4ea1-a1d5-78691be182df-delete_snapshot" released by "delete_snapshot" :: held 3.640s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-884f1980-9fc3-456a-a3a6-4acb2745f0f4-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-884f1980-9fc3-456a-a3a6-4acb2745f0f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-quobyte-884f1980-9fc3-456a-a3a6-4acb2745f0f4" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-884f1980-9fc3-456a-a3a6-4acb2745f0f4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Deleting offline snapshot 884f1980-9fc3-456a-a3a6-4acb2745f0f4 of volume 6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] snapshot_file for this snap is: volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e15477-18d3-4e10-8cc9-170a46f30748]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:58 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 Jul 08 18:28:58 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-42266d7f-d0ce-4dca-b40e-8fa917603d6d req-55256e78-cf1c-4fb5-892a-0a3bfae3a2ac tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-42266d7f-d0ce-4dca-b40e-8fa917603d6d req-55256e78-cf1c-4fb5-892a-0a3bfae3a2ac tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec9260-5003-4057-b833-f0cf8e46c708]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-42266d7f-d0ce-4dca-b40e-8fa917603d6d req-55256e78-cf1c-4fb5-892a-0a3bfae3a2ac tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:58 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 Jul 08 18:28:58 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:58 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4" returned: 0 in 0.796s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:28:59 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c41cff-77b5-42de-a81d-18ff55365ffe]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:28:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:59 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 Jul 08 18:28:59 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:28:59 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-42266d7f-d0ce-4dca-b40e-8fa917603d6d req-55256e78-cf1c-4fb5-892a-0a3bfae3a2ac tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-42266d7f-d0ce-4dca-b40e-8fa917603d6d req-55256e78-cf1c-4fb5-892a-0a3bfae3a2ac tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:28:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-42266d7f-d0ce-4dca-b40e-8fa917603d6d req-55256e78-cf1c-4fb5-892a-0a3bfae3a2ac tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61feaf5d-63d9-4264-956d-516e7573f351', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:28:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-42266d7f-d0ce-4dca-b40e-8fa917603d6d req-55256e78-cf1c-4fb5-892a-0a3bfae3a2ac tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] attachment_update completed successfully. Jul 08 18:28:59 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 08 18:28:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:28:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:28:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:28:59 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 Jul 08 18:28:59 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:00 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4" returned: 0 in 0.842s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:00 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4 Jul 08 18:29:00 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:01 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.884f1980-9fc3-456a-a3a6-4acb2745f0f4" returned: 0 in 0.625s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-884f1980-9fc3-456a-a3a6-4acb2745f0f4" released by "_delete_snapshot" :: held 3.197s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" released by "delete_snapshot" :: held 3.222s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:01 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Created reservations ['7563eda4-a4af-498a-801f-8c746971f190', 'bab70266-75dd-4d68-8073-16d57050a4be', '8146aa10-bb9b-41bf-b8d5-42224bfb0fa3', '9d14ab30-bbaf-4f54-b09f-0d6e53380084'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:29:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Delete snapshot completed successfully. Jul 08 18:29:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-33f9773a-15f7-4eee-9a26-ef63a3779c57 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-884f1980-9fc3-456a-a3a6-4acb2745f0f4-delete_snapshot" released by "delete_snapshot" :: held 3.359s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-54144041-5451-4619-9566-d7cb462e6654-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-54144041-5451-4619-9566-d7cb462e6654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-quobyte-54144041-5451-4619-9566-d7cb462e6654" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-54144041-5451-4619-9566-d7cb462e6654" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Deleting offline snapshot 54144041-5451-4619-9566-d7cb462e6654 of volume 6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] snapshot_file for this snap is: volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba4de50-ace5-437a-a5bd-9ded25b1681e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:02 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:29:02 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:02 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 Jul 08 18:29:02 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:03 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.671s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:29:03 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654" returned: 0 in 0.849s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed9e816-3731-4aa3-b761-2b9fcefbe8bc]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:03 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c Jul 08 18:29:03 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:04 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c" returned: 0 in 0.775s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:04 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 Jul 08 18:29:04 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:04 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654" returned: 0 in 0.768s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:04 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654 Jul 08 18:29:04 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:05 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c.54144041-5451-4619-9566-d7cb462e6654" returned: 0 in 0.635s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-54144041-5451-4619-9566-d7cb462e6654" released by "_delete_snapshot" :: held 3.129s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" released by "delete_snapshot" :: held 3.150s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:05 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Created reservations ['70a2618e-5366-45dd-947a-27b17a2b078a', '4456a64d-1eb8-44a3-9a56-46fb9fb2a6a5', '129a53ab-001d-416c-990d-2c498b30d47e', '6f327352-2962-49d1-b69f-0fa7edc76caa'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:29:05 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Delete snapshot completed successfully. Jul 08 18:29:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-97e641fd-aee6-4bca-a2d8-d10cc14e2f1e tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-54144041-5451-4619-9566-d7cb462e6654-delete_snapshot" released by "delete_snapshot" :: held 3.281s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-8c7fe1ff-2fb4-4749-8255-8bf253d65418 req-98d1f98d-deb5-4d3e-bd20-a34a059e6bf3 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Terminate volume connection completed successfully. Jul 08 18:29:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-8c7fe1ff-2fb4-4749-8255-8bf253d65418 req-98d1f98d-deb5-4d3e-bd20-a34a059e6bf3 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Deleting attachment 61feaf5d-63d9-4264-956d-516e7573f351. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:29:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-6c4fd296-517a-43e1-b2d9-7cae415ca51c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:29:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-6c4fd296-517a-43e1-b2d9-7cae415ca51c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:29:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:29:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:29:06 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[50634493-1ca2-49bc-9b7c-00e6404ceb88]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:06 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c Jul 08 18:29:06 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:07 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c" returned: 0 in 0.799s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:07 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c Jul 08 18:29:07 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:08 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6c4fd296-517a-43e1-b2d9-7cae415ca51c" returned: 0 in 0.696s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-quobyte-6c4fd296-517a-43e1-b2d9-7cae415ca51c" released by "delete_volume" :: held 1.564s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Created reservations ['eed2bd7a-a504-455f-90fc-380839aa25a0', '902bf280-6488-4945-9214-d3e0ae13876c', '973d24f0-ed23-4758-bb36-34951c80c1ef', '1c2527b5-f36a-4d96-ba8d-cded91f17dca'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:08 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:29:08 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Acquiring lock "cinder-40a1e7fa-f2cc-4dcc-9026-0b7edb776100-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "cinder-40a1e7fa-f2cc-4dcc-9026-0b7edb776100-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Acquiring lock "cinder-quobyte-40a1e7fa-f2cc-4dcc-9026-0b7edb776100" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "cinder-quobyte-40a1e7fa-f2cc-4dcc-9026-0b7edb776100" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c6d2c3-0809-4486-9237-219a13fac531]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:08 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 Jul 08 18:29:08 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:09 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.660s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:09 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:29:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Deleted volume successfully. Jul 08 18:29:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1c4b5577-8559-41e7-865f-a7730ea8fd73 tempest-VolumesSnapshotListTestJSON-119818655 None] Lock "cinder-6c4fd296-517a-43e1-b2d9-7cae415ca51c-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:09 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100" returned: 0 in 0.879s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:09 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100 Jul 08 18:29:09 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:10 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-40a1e7fa-f2cc-4dcc-9026-0b7edb776100" returned: 0 in 0.804s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "cinder-quobyte-40a1e7fa-f2cc-4dcc-9026-0b7edb776100" released by "delete_volume" :: held 1.746s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Created reservations ['f4bf861c-79a3-410a-891f-d454b25f07a8', 'ccced1af-cd55-4f46-b9ce-16ba5d02c864', 'b6e45883-fa1c-45e2-b464-ebee3d8e397a', '81bafec5-db18-4c36-bb36-8427e34f2af9'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:10 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:29:10 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:11 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.784s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:11 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:29:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Deleted volume successfully. Jul 08 18:29:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6eac8517-a0b6-42d5-b1a5-3008b88990e7 tempest-TestServerVolumeAttachScenarioOldVersion-1913149046 None] Lock "cinder-40a1e7fa-f2cc-4dcc-9026-0b7edb776100-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:29:20 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=64,cinder:DELETE=5,cinder:SELECT=58,cinder:INSERT=17 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:29:21 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=69,cinder:SELECT=61,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Flow 'volume_create_manager' (3591f075-5f5b-406e-8157-de42be6b3b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c03c2a-b37d-49a4-a0c8-a62698ec175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c03c2a-b37d-49a4-a0c8-a62698ec175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1880582797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f000a4-d04c-4c00-aa4b-90d2cfc74307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2347249157504adf8e60cf720937bed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:29:37Z,use_quota=True,user_id='18eda13aa92a4cc58e588cef7fb0c98f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0139d7a8-5089-4b64-9337-fe4f73f13e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0139d7a8-5089-4b64-9337-fe4f73f13e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288abe41-c222-4a99-9258-521aaaa796c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288abe41-c222-4a99-9258-521aaaa796c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73f000a4-d04c-4c00-aa4b-90d2cfc74307', 'volume_name': 'volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60219ea2-9a9d-4d00-87bb-1dd9abfbf610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60219ea2-9a9d-4d00-87bb-1dd9abfbf610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3480b7da-9523-436d-83dd-4d29189da14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:37 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Volume 73f000a4-d04c-4c00-aa4b-90d2cfc74307: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 18:29:37 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Trying to clone 73f000a4-d04c-4c00-aa4b-90d2cfc74307 from image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:29:38 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:29:38 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Image download 20.69 MB at 20.69 MB/s Jul 08 18:29:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a71c07-8727-49a5-8935-6b18e6ed3e70]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:38 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD Jul 08 18:29:38 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:38 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:38 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Temporary image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 is fetched for user 18eda13aa92a4cc58e588cef7fb0c98f. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:29:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[834e782e-4743-459b-be93-a3e5554c37d6]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:39 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD Jul 08 18:29:39 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:39 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1880582797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f000a4-d04c-4c00-aa4b-90d2cfc74307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2347249157504adf8e60cf720937bed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:29:37Z,use_quota=True,user_id='18eda13aa92a4cc58e588cef7fb0c98f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Creating volume 73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:29:39 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:29:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:39 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 1073741824 Jul 08 18:29:39 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:40 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 1073741824" returned: 0 in 0.955s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:40 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:29:40 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:41 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 0 in 0.655s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:29:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:41 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Attempting download of 2c4a33de-7646-4da0-8ea3-4caf9de5a137 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}])) to volume 73f000a4-d04c-4c00-aa4b-90d2cfc74307. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:29:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[96022833-488a-4200-97e2-5d22e1647c6b]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137__r0_h80z {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:41 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137__r0_h80z Jul 08 18:29:41 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:42 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137__r0_h80z" returned: 0 in 0.741s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137__r0_h80z {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:42 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137__r0_h80z Jul 08 18:29:42 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:42 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137__r0_h80z" returned: 1 in 0.720s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c4a33de-7646-4da0-8ea3-4caf9de5a137__r0_h80z' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:29:42 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[62263f2b-4d57-4212-bc41-d9c6af8f33ec]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:43 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD Jul 08 18:29:43 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:43 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:43 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] 2c4a33de-7646-4da0-8ea3-4caf9de5a137 was qcow2, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:29:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:43 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:29:43 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:45 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 0 in 2.086s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:45 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c4a33de-7646-4da0-8ea3-4caf9de5a137_afk91l9xdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:29:45 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Converted 112.00 MB image at 53.65 MB/s Jul 08 18:29:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:45 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 1G Jul 08 18:29:45 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:46 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 1G" returned: 0 in 0.746s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:46 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a760fd-6183-4aee-a1b9-5a15a1cc93a3]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:46 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:29:46 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:47 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 0 in 0.884s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:47 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:29:47 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:48 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 1 in 0.841s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Downloaded image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}])) to volume 73f000a4-d04c-4c00-aa4b-90d2cfc74307 successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Temporary image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 for user 18eda13aa92a4cc58e588cef7fb0c98f is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Marking volume 73f000a4-d04c-4c00-aa4b-90d2cfc74307 as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Copying metadata from image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 to 73f000a4-d04c-4c00-aa4b-90d2cfc74307. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Creating volume glance metadata for volume 73f000a4-d04c-4c00-aa4b-90d2cfc74307 backed by image 2c4a33de-7646-4da0-8ea3-4caf9de5a137 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3480b7da-9523-436d-83dd-4d29189da14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307', 'volume_size': 1, 'image_id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c86d45ecf5654973b933da8e44f65b73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2c4a33de-7646-4da0-8ea3-4caf9de5a137', 'created_at': datetime.datetime(2026, 7, 8, 16, 5, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 5, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c4a33de-7646-4da0-8ea3-4caf9de5a137/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ee704f-f9f2-4d6a-ac52-86e39a95f3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:48 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Volume volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 (73f000a4-d04c-4c00-aa4b-90d2cfc74307): created successfully Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ee704f-f9f2-4d6a-ac52-86e39a95f3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Flow 'volume_create_manager' (3591f075-5f5b-406e-8157-de42be6b3b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:29:48 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b86b22f9-791c-45d8-94e9-fe9fa783e37a tempest-TestShelveInstance-1571393685 None] Created volume successfully. Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Flow 'volume_create_manager' (27fb7c49-8359-4f42-baed-865c6c993434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd35f94-1663-4fc9-8d22-f6ff5a906b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd35f94-1663-4fc9-8d22-f6ff5a906b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1452831954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddea6986-2e53-432f-ac5e-f79758a0acde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff6403bc4ef4ef295d88e99ebf102df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:29:50Z,use_quota=True,user_id='72f35a68a18b4ef8ab27fc8c38c77c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ea0faa-0c79-42a0-9879-6cbe5fd906a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ea0faa-0c79-42a0-9879-6cbe5fd906a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f8dbd1-74f0-4cf5-aa59-9aeb137ae0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f8dbd1-74f0-4cf5-aa59-9aeb137ae0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddea6986-2e53-432f-ac5e-f79758a0acde', 'volume_name': 'volume-ddea6986-2e53-432f-ac5e-f79758a0acde', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f043d376-846a-4bfe-a75d-3f2f42d6dd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f043d376-846a-4bfe-a75d-3f2f42d6dd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709fe3c4-6d9f-4b1e-b18e-50306d738ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Volume ddea6986-2e53-432f-ac5e-f79758a0acde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddea6986-2e53-432f-ac5e-f79758a0acde', 'volume_size': 1} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1452831954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddea6986-2e53-432f-ac5e-f79758a0acde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff6403bc4ef4ef295d88e99ebf102df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:29:50Z,use_quota=True,user_id='72f35a68a18b4ef8ab27fc8c38c77c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Creating volume ddea6986-2e53-432f-ac5e-f79758a0acde {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:29:50 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:50 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde 1073741824 Jul 08 18:29:50 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Flow 'volume_create_manager' (f7915c8f-bcba-46ab-9a56-85433aa89cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194164dd-f981-4d05-830d-74c5c7c7eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194164dd-f981-4d05-830d-74c5c7c7eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-227718054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d899ff-1925-43bb-bce9-eb3098a1b647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff6403bc4ef4ef295d88e99ebf102df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:29:51Z,use_quota=True,user_id='72f35a68a18b4ef8ab27fc8c38c77c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891f7cb9-7bf0-450c-a68f-397cc2974f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891f7cb9-7bf0-450c-a68f-397cc2974f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047a6a48-c3bf-49d9-adfb-57425a245b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047a6a48-c3bf-49d9-adfb-57425a245b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d899ff-1925-43bb-bce9-eb3098a1b647', 'volume_name': 'volume-90d899ff-1925-43bb-bce9-eb3098a1b647', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7d34ec-2be9-4146-b1fd-b3d7ea5c10dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7d34ec-2be9-4146-b1fd-b3d7ea5c10dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f7d1f5-6e1e-4705-8f71-90021ad0ce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:51 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Volume 90d899ff-1925-43bb-bce9-eb3098a1b647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d899ff-1925-43bb-bce9-eb3098a1b647', 'volume_size': 1} Jul 08 18:29:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:51 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde 1073741824" returned: 0 in 0.892s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:51 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde Jul 08 18:29:51 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:52 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde" returned: 0 in 0.690s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-227718054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d899ff-1925-43bb-bce9-eb3098a1b647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff6403bc4ef4ef295d88e99ebf102df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:29:51Z,use_quota=True,user_id='72f35a68a18b4ef8ab27fc8c38c77c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Creating volume 90d899ff-1925-43bb-bce9-eb3098a1b647 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:29:52 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709fe3c4-6d9f-4b1e-b18e-50306d738ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddea6986-2e53-432f-ac5e-f79758a0acde', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:52 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 1073741824 Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bb33ef-dc38-4eeb-94ed-f1f4b3c033ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:52 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:52 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Volume volume-ddea6986-2e53-432f-ac5e-f79758a0acde (ddea6986-2e53-432f-ac5e-f79758a0acde): created successfully Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bb33ef-dc38-4eeb-94ed-f1f4b3c033ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Flow 'volume_create_manager' (27fb7c49-8359-4f42-baed-865c6c993434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:29:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6fc9e71d-6fce-42a2-bdea-e4d22afe4190 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Created volume successfully. Jul 08 18:29:53 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 1073741824" returned: 0 in 0.891s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:53 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 Jul 08 18:29:53 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:53 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647" returned: 0 in 0.691s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f7d1f5-6e1e-4705-8f71-90021ad0ce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d899ff-1925-43bb-bce9-eb3098a1b647', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc311be9-acec-4553-801c-59c4f32406fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:29:53 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Volume volume-90d899ff-1925-43bb-bce9-eb3098a1b647 (90d899ff-1925-43bb-bce9-eb3098a1b647): created successfully Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc311be9-acec-4553-801c-59c4f32406fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:29:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Flow 'volume_create_manager' (f7915c8f-bcba-46ab-9a56-85433aa89cb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:29:53 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1ca5130e-7ac6-4dec-bb3b-a6ceb48aee4b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Created volume successfully. Jul 08 18:29:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:29:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:29:56 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34a8ed3-189d-4085-afd7-871b6b8e4ebb]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:29:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:56 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:29:56 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:57 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 0 in 0.881s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:29:57 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:29:57 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:29:58 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 08 18:29:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 1 in 0.779s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:29:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:29:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.731s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:29:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '705518f1-1810-4d00-89c3-87c6610b9468', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:29:58 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-23908020-c1fe-44c9-8d07-6476bcddd4ec req-c5d5af68-2035-4386-9bfb-45e13e7c9e30 tempest-TestShelveInstance-1571393685 None] attachment_update completed successfully. Jul 08 18:30:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:30:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:30:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:30:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:02 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:30:02 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:03 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.710s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:30:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:30:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:30:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:30:08 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=21,cinder:INSERT=10,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:30:08 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=13,cinder:SELECT=17,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:30:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-4c0fffb4-9a5f-48be-abbd-44dce8984f8d req-ab6bc537-4bf1-4aed-bde4-d2b97b8b342b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-4c0fffb4-9a5f-48be-abbd-44dce8984f8d req-ab6bc537-4bf1-4aed-bde4-d2b97b8b342b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[372d199b-054d-486e-a9da-0f86c6dea3ee]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:30:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-4c0fffb4-9a5f-48be-abbd-44dce8984f8d req-ab6bc537-4bf1-4aed-bde4-d2b97b8b342b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:34 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde Jul 08 18:30:34 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:34 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-4c0fffb4-9a5f-48be-abbd-44dce8984f8d req-ab6bc537-4bf1-4aed-bde4-d2b97b8b342b tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde" returned: 0 in 0.828s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-4c0fffb4-9a5f-48be-abbd-44dce8984f8d req-ab6bc537-4bf1-4aed-bde4-d2b97b8b342b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-4c0fffb4-9a5f-48be-abbd-44dce8984f8d req-ab6bc537-4bf1-4aed-bde4-d2b97b8b342b tempest-TestServerVolumeAttachmentScenario-1638050674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-ddea6986-2e53-432f-ac5e-f79758a0acde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11f878b6-62cf-4017-9e31-6f0c626381eb', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:30:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-4c0fffb4-9a5f-48be-abbd-44dce8984f8d req-ab6bc537-4bf1-4aed-bde4-d2b97b8b342b tempest-TestServerVolumeAttachmentScenario-1638050674 None] attachment_update completed successfully. Jul 08 18:30:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-2a2a333e-451a-463c-a44c-748d4cac7b38 req-d7037517-f410-4419-b3c3-7c24124a1dec tempest-TestShelveInstance-1571393685 None] Terminate volume connection completed successfully. Jul 08 18:30:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-2a2a333e-451a-463c-a44c-748d4cac7b38 req-d7037517-f410-4419-b3c3-7c24124a1dec tempest-TestShelveInstance-1571393685 None] Deleting attachment 705518f1-1810-4d00-89c3-87c6610b9468. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:30:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7f1f13-abf3-49c5-a8b7-71150e197f7e]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:30:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:40 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:30:40 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:41 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 0 in 0.762s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:41 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:30:41 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:42 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 1 in 0.723s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:30:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.533s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30742dcf-aab0-4b9f-9a8b-818d5fd8f7c3', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:30:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-961dcb18-5339-4ecd-8b20-a59e2f27183e req-a105eb2d-bd85-4710-8323-2d6c498f4689 tempest-TestShelveInstance-1571393685 None] attachment_update completed successfully. Jul 08 18:30:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-bd73e876-8b60-4028-b120-a4bd500585d8 req-db69d1c5-457e-47ec-892e-81998fdc9b10 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:30:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-bd73e876-8b60-4028-b120-a4bd500585d8 req-db69d1c5-457e-47ec-892e-81998fdc9b10 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:30:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[48956478-b3a2-4e18-ad2b-779ec1d46a9a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:30:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-bd73e876-8b60-4028-b120-a4bd500585d8 req-db69d1c5-457e-47ec-892e-81998fdc9b10 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:30:44 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 Jul 08 18:30:44 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:30:45 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 08 18:30:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-bd73e876-8b60-4028-b120-a4bd500585d8 req-db69d1c5-457e-47ec-892e-81998fdc9b10 tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647" returned: 0 in 0.827s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:30:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-bd73e876-8b60-4028-b120-a4bd500585d8 req-db69d1c5-457e-47ec-892e-81998fdc9b10 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.845s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:30:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-bd73e876-8b60-4028-b120-a4bd500585d8 req-db69d1c5-457e-47ec-892e-81998fdc9b10 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229', 'name': 'volume-90d899ff-1925-43bb-bce9-eb3098a1b647', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12a98a70-cc20-4528-bb7a-8bfe597e4228', 'enforce_multipath': True} {{(pid=87309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 18:30:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-bd73e876-8b60-4028-b120-a4bd500585d8 req-db69d1c5-457e-47ec-892e-81998fdc9b10 tempest-TestServerVolumeAttachmentScenario-1638050674 None] attachment_update completed successfully. Jul 08 18:30:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-96dd5819-46e7-4685-8291-e4c2cb3b858b req-168ac1f1-c7ca-4026-bcdc-844fa61f6848 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Terminate volume connection completed successfully. Jul 08 18:30:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-96dd5819-46e7-4685-8291-e4c2cb3b858b req-168ac1f1-c7ca-4026-bcdc-844fa61f6848 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Deleting attachment 12a98a70-cc20-4528-bb7a-8bfe597e4228. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:30:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-db513b14-addc-43bd-8f1d-4f312b852e79 req-44be3035-3386-4e4f-a3d8-dfa841b5a51f tempest-TestServerVolumeAttachmentScenario-1638050674 None] Terminate volume connection completed successfully. Jul 08 18:30:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-db513b14-addc-43bd-8f1d-4f312b852e79 req-44be3035-3386-4e4f-a3d8-dfa841b5a51f tempest-TestServerVolumeAttachmentScenario-1638050674 None] Deleting attachment 11f878b6-62cf-4017-9e31-6f0c626381eb. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:31:01 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=22,cinder:UPDATE=6 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:31:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:31:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:02 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:31:02 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:03 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.683s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:31:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:31:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:31:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:31:06 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:31:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "cinder-90d899ff-1925-43bb-bce9-eb3098a1b647-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "cinder-90d899ff-1925-43bb-bce9-eb3098a1b647-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "cinder-quobyte-90d899ff-1925-43bb-bce9-eb3098a1b647" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:07 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "cinder-quobyte-90d899ff-1925-43bb-bce9-eb3098a1b647" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:07 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5715d-ccfb-4fbe-a3cc-cb9fa545b8d4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:07 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 Jul 08 18:31:07 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:08 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647" returned: 0 in 0.823s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:08 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647 Jul 08 18:31:08 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:08 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-90d899ff-1925-43bb-bce9-eb3098a1b647" returned: 0 in 0.644s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "cinder-quobyte-90d899ff-1925-43bb-bce9-eb3098a1b647" released by "delete_volume" :: held 1.519s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Created reservations ['7468ccaa-7e0c-4f3c-a80d-dc98c538b94f', 'f0781fca-c0a1-4f6c-8348-1f4436c89d01', '4b783a72-f844-4ced-a244-0a138c7f485a', 'edd5892c-08bf-4cc6-9027-a752c268fa2a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:08 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:31:08 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "cinder-ddea6986-2e53-432f-ac5e-f79758a0acde-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "cinder-ddea6986-2e53-432f-ac5e-f79758a0acde-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "cinder-quobyte-ddea6986-2e53-432f-ac5e-f79758a0acde" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "cinder-quobyte-ddea6986-2e53-432f-ac5e-f79758a0acde" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae44aad8-e1ee-4d64-84dd-29d47aa5aeaa]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:09 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.678s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:31:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Deleted volume successfully. Jul 08 18:31:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7ebdbeb2-0e58-4674-8f7b-12d058d9a774 tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "cinder-90d899ff-1925-43bb-bce9-eb3098a1b647-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:09 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde Jul 08 18:31:09 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:10 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde" returned: 0 in 0.812s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:10 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde Jul 08 18:31:10 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:10 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ddea6986-2e53-432f-ac5e-f79758a0acde" returned: 0 in 0.649s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "cinder-quobyte-ddea6986-2e53-432f-ac5e-f79758a0acde" released by "delete_volume" :: held 1.513s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Created reservations ['7488c1a1-4b8c-44cd-8f6b-0b890138555c', 'ec477a41-9365-4c25-902e-fd09eb54ea71', 'cd77ec7e-b528-456c-9305-b9b9f7dd77c7', '33f873ee-ac96-4248-bdda-a15df973aae5'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:11 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:31:11 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:11 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.702s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:31:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Deleted volume successfully. Jul 08 18:31:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-651439be-4594-46ca-a09f-1a16f69d338d tempest-TestServerVolumeAttachmentScenario-1638050674 None] Lock "cinder-ddea6986-2e53-432f-ac5e-f79758a0acde-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:21 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=6,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:31:21 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:31:21 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-48ed4f48-42e4-44ba-9e98-8f5e95e56fdd tempest-TestShelveInstance-1571393685 None] Terminate volume connection completed successfully. Jul 08 18:31:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-48ed4f48-42e4-44ba-9e98-8f5e95e56fdd tempest-TestShelveInstance-1571393685 None] Deleting attachment 30742dcf-aab0-4b9f-9a8b-818d5fd8f7c3. {{(pid=87309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 18:31:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Acquiring lock "cinder-73f000a4-d04c-4c00-aa4b-90d2cfc74307-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Lock "cinder-73f000a4-d04c-4c00-aa4b-90d2cfc74307-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Acquiring lock "cinder-quobyte-73f000a4-d04c-4c00-aa4b-90d2cfc74307" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Lock "cinder-quobyte-73f000a4-d04c-4c00-aa4b-90d2cfc74307" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:22 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec81ae-7359-455e-9145-fc63bbc85ad6]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:22 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:31:22 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:23 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 0 in 0.786s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:23 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:31:23 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:24 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 1 in 0.803s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:31:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:24 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307 Jul 08 18:31:24 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:24 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-73f000a4-d04c-4c00-aa4b-90d2cfc74307" returned: 0 in 0.717s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Lock "cinder-quobyte-73f000a4-d04c-4c00-aa4b-90d2cfc74307" released by "delete_volume" :: held 2.386s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:25 devstack cinder-volume[87309]: DEBUG cinder.quota [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Created reservations ['0f9bc159-adc7-4f56-9284-2e568b890027', '1e2aeefe-2856-4a7e-9c99-e9380c92eada', '110a190e-37c5-4f6c-ba43-0c59f61a77a4', 'b6fac47f-a404-42b6-b2b1-33af734cbfdb'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:31:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:25 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:31:25 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:26 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.827s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.manager [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:31:26 devstack cinder-volume[87309]: INFO cinder.volume.manager [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Deleted volume successfully. Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [req-7cf16074-448a-4ffe-bfa6-8f4dfeafbf82 req-16a907d6-243f-47cd-8e03-12472b2b01c2 tempest-TestShelveInstance-1571393685 None] Lock "cinder-73f000a4-d04c-4c00-aa4b-90d2cfc74307-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Flow 'volume_create_manager' (fc2565d4-672d-45dd-be58-d5a1cbe64bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aebe2ff5-509f-4625-991b-26eef0ef9ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aebe2ff5-509f-4625-991b-26eef0ef9ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278205f0-516e-430d-aafc-883832eb8c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264e3b6f3a1f45c597cd35349442fc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:27Z,use_quota=True,user_id='09724ead64204beca9f1fe6ed5f36d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3685a7d8-0635-43a6-9345-0d198543cb4d),volume_type_id=3685a7d8-0635-43a6-9345-0d198543cb4d)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87b10e6-06cf-47ca-8b25-7b53d1cdb1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87b10e6-06cf-47ca-8b25-7b53d1cdb1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627079c8-b9d6-4acc-9c90-56a38d1cf4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627079c8-b9d6-4acc-9c90-56a38d1cf4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '278205f0-516e-430d-aafc-883832eb8c50', 'volume_name': 'volume-278205f0-516e-430d-aafc-883832eb8c50', 'volume_size': 1, 'image_id': 'bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f0c4c61b79906d1e8edef71a91ed49b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '264e3b6f3a1f45c597cd35349442fc03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '861cef43c8a9ce2346fc44dfe1c328f5b01fb61061cb13dc4fe399ea95afc9fa669c79a506e6ba267ec3385480eb9f1f8a2311d5c1eaa4ad683975cafc064103', 'id': 'bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'created_at': datetime.datetime(2026, 7, 8, 16, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a69749-02ec-4089-bc20-28ef7a9ce382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a69749-02ec-4089-bc20-28ef7a9ce382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04545968-6ab4-4b73-bf6b-36d75511e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:26 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Volume 278205f0-516e-430d-aafc-883832eb8c50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-278205f0-516e-430d-aafc-883832eb8c50', 'volume_size': 1, 'image_id': 'bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f0c4c61b79906d1e8edef71a91ed49b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '264e3b6f3a1f45c597cd35349442fc03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '861cef43c8a9ce2346fc44dfe1c328f5b01fb61061cb13dc4fe399ea95afc9fa669c79a506e6ba267ec3385480eb9f1f8a2311d5c1eaa4ad683975cafc064103', 'id': 'bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'created_at': datetime.datetime(2026, 7, 8, 16, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 18:31:26 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Trying to clone 278205f0-516e-430d-aafc-883832eb8c50 from image bd145a96-7dfa-42e4-b5aa-29a7b0f828e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:31:27 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:31:27 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:31:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0f980a-cff5-49bf-aafd-d8adbd002116]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:27 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD Jul 08 18:31:27 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:27 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:28 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD Jul 08 18:31:28 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:28 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD" returned: 1 in 0.799s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:31:28 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Temporary image bd145a96-7dfa-42e4-b5aa-29a7b0f828e0 is fetched for user 09724ead64204beca9f1fe6ed5f36d6b. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:31:28 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f111999a-cbcb-44f5-b182-f9903f147b99]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:28 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD Jul 08 18:31:28 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:29 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:29 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD Jul 08 18:31:29 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:30 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD" returned: 1 in 0.776s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278205f0-516e-430d-aafc-883832eb8c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264e3b6f3a1f45c597cd35349442fc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:27Z,use_quota=True,user_id='09724ead64204beca9f1fe6ed5f36d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3685a7d8-0635-43a6-9345-0d198543cb4d),volume_type_id=3685a7d8-0635-43a6-9345-0d198543cb4d)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Creating volume 278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:30 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:31:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:30 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 1073741824 Jul 08 18:31:30 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:31 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 1073741824" returned: 0 in 0.906s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:31 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 Jul 08 18:31:31 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:31 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50" returned: 0 in 0.631s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:31 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Attempting download of bd145a96-7dfa-42e4-b5aa-29a7b0f828e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'metadata': {}}])) to volume 278205f0-516e-430d-aafc-883832eb8c50. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:31:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bd68bb-c802-4f42-aa06-11192367d6ea]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_ojmbw4w5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:32 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_ojmbw4w5 Jul 08 18:31:32 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:32 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_ojmbw4w5" returned: 0 in 0.827s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_ojmbw4w5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:32 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_ojmbw4w5 Jul 08 18:31:32 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:33 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_ojmbw4w5" returned: 1 in 0.761s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_ojmbw4w5' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:31:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ebc074-2244-4c6b-aff6-511be70777a5]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:33 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD Jul 08 18:31:33 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:34 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:34 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD Jul 08 18:31:34 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:35 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD" returned: 1 in 0.809s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:31:35 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] bd145a96-7dfa-42e4-b5aa-29a7b0f828e0 was raw, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:31:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:35 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 Jul 08 18:31:35 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:36 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50" returned: 0 in 0.866s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:36 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bd145a96-7dfa-42e4-b5aa-29a7b0f828e0_1xvqci3hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:31:36 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:31:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:36 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 1G Jul 08 18:31:36 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:36 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 1G" returned: 0 in 0.767s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:36 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffcd439-0872-482d-bb30-bbaaaba148e3]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:36 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 Jul 08 18:31:36 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (7e44529b-4297-4436-8be2-e419d5e194b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176f7591-fad1-4712-98d6-62d7d3da1878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176f7591-fad1-4712-98d6-62d7d3da1878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2044647760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9bff35-04a0-4c8a-9047-bb1d305db746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:37Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7145879-7899-4c32-8c81-7f5d64750d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7145879-7899-4c32-8c81-7f5d64750d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd237800-5597-4587-adf0-9635a90df4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd237800-5597-4587-adf0-9635a90df4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9bff35-04a0-4c8a-9047-bb1d305db746', 'volume_name': 'volume-ea9bff35-04a0-4c8a-9047-bb1d305db746', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0933f6ce-fc73-41ca-b31f-e002d91aa85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0933f6ce-fc73-41ca-b31f-e002d91aa85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f719ec-612f-4e66-a6e2-f749ec844f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:37 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume ea9bff35-04a0-4c8a-9047-bb1d305db746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9bff35-04a0-4c8a-9047-bb1d305db746', 'volume_size': 1} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2044647760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9bff35-04a0-4c8a-9047-bb1d305db746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:37Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Creating volume ea9bff35-04a0-4c8a-9047-bb1d305db746 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:37 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:37 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 1073741824 Jul 08 18:31:37 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:37 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50" returned: 0 in 0.770s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:37 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 Jul 08 18:31:37 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:38 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 1073741824" returned: 0 in 0.850s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:38 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 Jul 08 18:31:38 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:38 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50" returned: 1 in 0.839s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Downloaded image bd145a96-7dfa-42e4-b5aa-29a7b0f828e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'metadata': {}}])) to volume 278205f0-516e-430d-aafc-883832eb8c50 successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Temporary image bd145a96-7dfa-42e4-b5aa-29a7b0f828e0 for user 09724ead64204beca9f1fe6ed5f36d6b is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Marking volume 278205f0-516e-430d-aafc-883832eb8c50 as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Copying metadata from image bd145a96-7dfa-42e4-b5aa-29a7b0f828e0 to 278205f0-516e-430d-aafc-883832eb8c50. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Creating volume glance metadata for volume 278205f0-516e-430d-aafc-883832eb8c50 backed by image bd145a96-7dfa-42e4-b5aa-29a7b0f828e0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1f0c4c61b79906d1e8edef71a91ed49b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04545968-6ab4-4b73-bf6b-36d75511e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278205f0-516e-430d-aafc-883832eb8c50', 'volume_size': 1, 'image_id': 'bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f0c4c61b79906d1e8edef71a91ed49b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '264e3b6f3a1f45c597cd35349442fc03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '861cef43c8a9ce2346fc44dfe1c328f5b01fb61061cb13dc4fe399ea95afc9fa669c79a506e6ba267ec3385480eb9f1f8a2311d5c1eaa4ad683975cafc064103', 'id': 'bd145a96-7dfa-42e4-b5aa-29a7b0f828e0', 'created_at': datetime.datetime(2026, 7, 8, 16, 31, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 31, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd145a96-7dfa-42e4-b5aa-29a7b0f828e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7946cae-f4b9-456e-aed6-81b0143f4986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Volume volume-278205f0-516e-430d-aafc-883832eb8c50 (278205f0-516e-430d-aafc-883832eb8c50): created successfully Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7946cae-f4b9-456e-aed6-81b0143f4986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Flow 'volume_create_manager' (fc2565d4-672d-45dd-be58-d5a1cbe64bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-fa521b5a-ca63-426b-9442-ccd135d4eb33 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Created volume successfully. Jul 08 18:31:38 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746" returned: 0 in 0.649s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f719ec-612f-4e66-a6e2-f749ec844f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9bff35-04a0-4c8a-9047-bb1d305db746', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3bcd37-2f97-4426-9ebf-78c149379d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:39 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 (ea9bff35-04a0-4c8a-9047-bb1d305db746): created successfully Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3bcd37-2f97-4426-9ebf-78c149379d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (7e44529b-4297-4436-8be2-e419d5e194b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:39 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-795c6c66-04b8-4998-bb22-7ed1fc57bbab tempest-CreateVolumesFromSnapshotTest-241245498 None] Created volume successfully. Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Acquiring lock "cinder-278205f0-516e-430d-aafc-883832eb8c50-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "cinder-278205f0-516e-430d-aafc-883832eb8c50-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Acquiring lock "cinder-quobyte-278205f0-516e-430d-aafc-883832eb8c50" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "cinder-quobyte-278205f0-516e-430d-aafc-883832eb8c50" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0eab16-c870-414a-b4c3-fc28d44fe6e4]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Creating offline snapshot 5a3eb960-49c0-45f1-baab-6992eed658a5 of volume ea9bff35-04a0-4c8a-9047-bb1d305db746 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fa999b-83d2-4ef7-b907-554b73959db2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:39 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 Jul 08 18:31:39 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:39 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 Jul 08 18:31:39 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:40 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50" returned: 0 in 0.781s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:40 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746" returned: 0 in 0.783s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:40 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 1G Jul 08 18:31:40 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:40 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 Jul 08 18:31:40 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:41 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50" returned: 1 in 0.800s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:31:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:41 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50 Jul 08 18:31:41 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:41 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 1G" returned: 0 in 0.832s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:41 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 Jul 08 18:31:41 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:41 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-278205f0-516e-430d-aafc-883832eb8c50" returned: 0 in 0.669s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "cinder-quobyte-278205f0-516e-430d-aafc-883832eb8c50" released by "delete_volume" :: held 2.332s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:41 devstack cinder-volume[87309]: WARNING cinder.quota [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:31:41 devstack cinder-volume[87309]: WARNING cinder.quota [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 18:31:41 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Created reservations ['a08cd4a8-7c37-4454-8a01-838f9513f335', '83157a96-4362-4448-bc26-e71c9468c269', '16f3a1de-0134-48a8-ae5d-2e34e4cca138', '0045a8a4-d44f-4f53-bea9-a2746970ab10'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:31:42 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5" returned: 0 in 0.702s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:42 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 is being set with open permissions: ugo+rw Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:42 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 Jul 08 18:31:42 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:42 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:31:42 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:42 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5" returned: 0 in 0.711s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:42 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.677s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:31:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Deleted volume successfully. Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dd350bf9-3899-4c90-915d-51bd91c54d72 tempest-VolumeAndVolumeTypeFromImageTest-1347532198 None] Lock "cinder-278205f0-516e-430d-aafc-883832eb8c50-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:42 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.info Jul 08 18:31:42 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:43 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.info" returned: 0 in 0.716s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:43 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.info is being set with open permissions: ugo+rw Jul 08 18:31:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:43 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.info Jul 08 18:31:43 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:44 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.info" returned: 0 in 0.675s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.544s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-692139e9-78f4-42ff-ac66-57bad6b1fd80 tempest-CreateVolumesFromSnapshotTest-241245498 None] Create snapshot completed successfully Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (d51ef88e-a25d-4f97-8a53-9f22e2eade5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac68a3e-0de8-4efd-a1ae-76bb15207a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac68a3e-0de8-4efd-a1ae-76bb15207a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220518600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952f5b11-6dd1-4c2d-ad0e-686d5c6daa45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:45Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc63210-5b0b-4ca6-b89d-5ed0594eb4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc63210-5b0b-4ca6-b89d-5ed0594eb4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab07936-79ca-49ac-805c-bec3106a353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab07936-79ca-49ac-805c-bec3106a353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '952f5b11-6dd1-4c2d-ad0e-686d5c6daa45', 'volume_name': 'volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10ef68e-be22-4b75-bd5b-86f9881ee230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10ef68e-be22-4b75-bd5b-86f9881ee230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7138cb19-d2ce-407d-b83f-2023cc85643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume 952f5b11-6dd1-4c2d-ad0e-686d5c6daa45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45', 'volume_size': 1} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220518600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952f5b11-6dd1-4c2d-ad0e-686d5c6daa45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:45Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Creating volume 952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:45 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:45 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 1073741824 Jul 08 18:31:45 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (655a06cc-3964-44e8-9063-c8c2a5971c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b992cc-e5aa-49d2-81db-e66a8d887d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b992cc-e5aa-49d2-81db-e66a8d887d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216184427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa543ca-f23c-4b2c-80c0-cfd936c01d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:46Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d72e779-6084-4e3e-b41a-af5b83dcc0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d72e779-6084-4e3e-b41a-af5b83dcc0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6167c8-be81-4e48-95c1-50a50e2aad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6167c8-be81-4e48-95c1-50a50e2aad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa543ca-f23c-4b2c-80c0-cfd936c01d5c', 'volume_name': 'volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504d5e1d-41cc-4881-8b79-1c2162577705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504d5e1d-41cc-4881-8b79-1c2162577705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9b1e67-ece1-45c4-b869-4399b75a26e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:45 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume 3fa543ca-f23c-4b2c-80c0-cfd936c01d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c', 'volume_size': 1} Jul 08 18:31:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (12b1f6ea-b4c4-47a3-b1d1-bcc5169ed568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792a355c-7cd2-4adb-a2ff-21a7ad9b2992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792a355c-7cd2-4adb-a2ff-21a7ad9b2992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1292715372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7efc8c-84db-41c7-87d5-30c91f3ed7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:46Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43dbd36-832f-422b-8355-b5712579252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43dbd36-832f-422b-8355-b5712579252e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0277c0-a718-4d68-953a-16ec41bf600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0277c0-a718-4d68-953a-16ec41bf600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7efc8c-84db-41c7-87d5-30c91f3ed7ef', 'volume_name': 'volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b140d3e0-45a8-4071-ba44-b6b249ae5f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b140d3e0-45a8-4071-ba44-b6b249ae5f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58c41bb-86b2-4a7f-93e6-dc00e844f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume 4d7efc8c-84db-41c7-87d5-30c91f3ed7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef', 'volume_size': 1} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:46 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 1073741824" returned: 0 in 1.150s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:46 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 Jul 08 18:31:46 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (39498d20-502f-4e76-859c-a463a236f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c58596-8803-4c76-8446-93f479a2cda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c58596-8803-4c76-8446-93f479a2cda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650726161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6129863f-ce79-482d-b856-a969e734b625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:47Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a758adde-e902-45f4-b04b-faae200bee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a758adde-e902-45f4-b04b-faae200bee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50425ac3-4a07-42e6-8820-9e29e660a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50425ac3-4a07-42e6-8820-9e29e660a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6129863f-ce79-482d-b856-a969e734b625', 'volume_name': 'volume-6129863f-ce79-482d-b856-a969e734b625', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b990fc-da8e-441e-a649-01a8b62d7df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b990fc-da8e-441e-a649-01a8b62d7df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82826e86-5275-4197-bf53-5c35a3e4ca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:46 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume 6129863f-ce79-482d-b856-a969e734b625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6129863f-ce79-482d-b856-a969e734b625', 'volume_size': 1} Jul 08 18:31:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (414d14bf-7082-43a4-8d9d-613a95fe8f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87da07e9-de97-410a-b69a-5bbec6bbabb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87da07e9-de97-410a-b69a-5bbec6bbabb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1047498992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a4f8af-9e27-4677-9929-caf6fbd8b775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:47Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af6a0d1-c788-4102-929b-c542d2004102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af6a0d1-c788-4102-929b-c542d2004102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89e12b0-8e32-476a-bdcc-64624e8fd8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89e12b0-8e32-476a-bdcc-64624e8fd8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a4f8af-9e27-4677-9929-caf6fbd8b775', 'volume_name': 'volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48abafa-2348-4bef-8944-e011b8747bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48abafa-2348-4bef-8944-e011b8747bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5469775-3442-4709-889b-69b9600b739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:47 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume c1a4f8af-9e27-4677-9929-caf6fbd8b775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775', 'volume_size': 1} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:47 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45" returned: 0 in 0.766s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216184427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa543ca-f23c-4b2c-80c0-cfd936c01d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:46Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Creating volume 3fa543ca-f23c-4b2c-80c0-cfd936c01d5c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:47 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7138cb19-d2ce-407d-b83f-2023cc85643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:47 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c 1073741824 Jul 08 18:31:47 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759a48be-a147-4506-87ed-6e0320cfe5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:47 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 (952f5b11-6dd1-4c2d-ad0e-686d5c6daa45): created successfully Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759a48be-a147-4506-87ed-6e0320cfe5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:47 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (d51ef88e-a25d-4f97-8a53-9f22e2eade5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-098a7299-1c17-4776-ad51-abdf0067591b tempest-CreateVolumesFromSnapshotTest-241245498 None] Created volume successfully. Jul 08 18:31:48 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c 1073741824" returned: 0 in 0.916s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Flow 'volume_create_manager' (1e880b4f-ed42-49f7-bf66-5caa8f730e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e2048f-de9e-41e1-a5d9-401e05ec00be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e2048f-de9e-41e1-a5d9-401e05ec00be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2088381518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c39b5ad-7f76-4a0c-ab64-1eca9250497f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8273755bf6a24acd88f7502b5fd13caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:48Z,use_quota=True,user_id='1c955bc8a46d4b4a983778770fd5b537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95781e9-f73a-4d56-93aa-d10228fc7caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95781e9-f73a-4d56-93aa-d10228fc7caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87abeb43-cd13-4ea3-b776-91229517e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87abeb43-cd13-4ea3-b776-91229517e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c39b5ad-7f76-4a0c-ab64-1eca9250497f', 'volume_name': 'volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f7d6cc-8d7b-4e1f-b2c3-ca17d07cf721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f7d6cc-8d7b-4e1f-b2c3-ca17d07cf721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcd670f-a77c-4985-8f82-874f9d0a24be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:48 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Volume 0c39b5ad-7f76-4a0c-ab64-1eca9250497f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f', 'volume_size': 1} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:48 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c Jul 08 18:31:48 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:49 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c" returned: 0 in 0.646s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.799s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1292715372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7efc8c-84db-41c7-87d5-30c91f3ed7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:46Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Creating volume 4d7efc8c-84db-41c7-87d5-30c91f3ed7ef {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:49 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:49 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef 1073741824 Jul 08 18:31:49 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9b1e67-ece1-45c4-b869-4399b75a26e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341bf661-2910-437e-bec6-29e7f4baa524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:49 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c (3fa543ca-f23c-4b2c-80c0-cfd936c01d5c): created successfully Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341bf661-2910-437e-bec6-29e7f4baa524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (655a06cc-3964-44e8-9063-c8c2a5971c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0a177a88-ac1f-404d-b753-5d7f99cdd9b4 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created volume successfully. Jul 08 18:31:50 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef 1073741824" returned: 0 in 0.815s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:50 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef Jul 08 18:31:50 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:50 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef" returned: 0 in 0.651s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.861s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650726161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6129863f-ce79-482d-b856-a969e734b625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:47Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Creating volume 6129863f-ce79-482d-b856-a969e734b625 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:50 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58c41bb-86b2-4a7f-93e6-dc00e844f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:50 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 1073741824 Jul 08 18:31:50 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2580d71-d29f-4a59-8d52-fb01a6b933aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef (4d7efc8c-84db-41c7-87d5-30c91f3ed7ef): created successfully Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2580d71-d29f-4a59-8d52-fb01a6b933aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (12b1f6ea-b4c4-47a3-b1d1-bcc5169ed568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3bf4f2b6-3d83-4c7d-8d51-9a0adb8ab7c1 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created volume successfully. Jul 08 18:31:51 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 1073741824" returned: 0 in 0.862s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:51 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 Jul 08 18:31:51 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:52 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625" returned: 0 in 0.700s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.138s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1047498992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a4f8af-9e27-4677-9929-caf6fbd8b775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59c6270d64948b59b67274a70aed22a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:47Z,use_quota=True,user_id='b4751ed433904d1db1f124896a84da5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Creating volume c1a4f8af-9e27-4677-9929-caf6fbd8b775 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:52 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82826e86-5275-4197-bf53-5c35a3e4ca44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6129863f-ce79-482d-b856-a969e734b625', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:52 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 1073741824 Jul 08 18:31:52 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc3f637-eceb-46cc-bac9-f639ade79e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:52 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume volume-6129863f-ce79-482d-b856-a969e734b625 (6129863f-ce79-482d-b856-a969e734b625): created successfully Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc3f637-eceb-46cc-bac9-f639ade79e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (39498d20-502f-4e76-859c-a463a236f031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a6aee064-d9ae-4297-82ea-0e4d94493275 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created volume successfully. Jul 08 18:31:53 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 1073741824" returned: 0 in 0.924s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:53 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 Jul 08 18:31:53 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:54 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775" returned: 0 in 0.721s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.475s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2088381518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c39b5ad-7f76-4a0c-ab64-1eca9250497f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8273755bf6a24acd88f7502b5fd13caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:31:48Z,use_quota=True,user_id='1c955bc8a46d4b4a983778770fd5b537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Creating volume 0c39b5ad-7f76-4a0c-ab64-1eca9250497f {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:31:54 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:54 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f 1073741824 Jul 08 18:31:54 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5469775-3442-4709-889b-69b9600b739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d208963b-8f20-48de-92c6-5f0476d89eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:54 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Volume volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 (c1a4f8af-9e27-4677-9929-caf6fbd8b775): created successfully Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d208963b-8f20-48de-92c6-5f0476d89eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Flow 'volume_create_manager' (414d14bf-7082-43a4-8d9d-613a95fe8f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:54 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-283602c0-cf5f-405e-bf26-1e2d533f3fa5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created volume successfully. Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-c1a4f8af-9e27-4677-9929-caf6fbd8b775-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-c1a4f8af-9e27-4677-9929-caf6fbd8b775-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-quobyte-c1a4f8af-9e27-4677-9929-caf6fbd8b775" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-c1a4f8af-9e27-4677-9929-caf6fbd8b775" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9991634-b659-459b-b3c3-0c6ee3a4b49d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:54 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f 1073741824" returned: 0 in 0.960s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:55 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f Jul 08 18:31:55 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:55 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 Jul 08 18:31:55 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:55 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f" returned: 0 in 0.747s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:55 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775" returned: 0 in 0.845s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:55 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775 Jul 08 18:31:55 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcd670f-a77c-4985-8f82-874f9d0a24be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316bf8da-371e-4d10-b273-cd39342edd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:31:55 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Volume volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f (0c39b5ad-7f76-4a0c-ab64-1eca9250497f): created successfully Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316bf8da-371e-4d10-b273-cd39342edd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:31:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Flow 'volume_create_manager' (1e880b4f-ed42-49f7-bf66-5caa8f730e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:31:55 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f4509b3e-6120-48ca-ad7e-8774c57a4264 tempest-ProjectReaderTests-1404347013 None] Created volume successfully. Jul 08 18:31:56 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c1a4f8af-9e27-4677-9929-caf6fbd8b775" returned: 0 in 0.711s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-c1a4f8af-9e27-4677-9929-caf6fbd8b775" released by "delete_volume" :: held 1.600s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Created reservations ['8c1aea68-4c01-4440-8868-c6fd4a970781', '654ddf10-8054-452c-9d8a-194765a49fa4', '384fc25c-8167-4279-95a9-5970b7be878e', 'b77682a2-3273-4deb-8d84-f0c030ecf04a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:56 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:31:56 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-6129863f-ce79-482d-b856-a969e734b625-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-6129863f-ce79-482d-b856-a969e734b625-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Acquiring lock "cinder-0c39b5ad-7f76-4a0c-ab64-1eca9250497f-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Lock "cinder-0c39b5ad-7f76-4a0c-ab64-1eca9250497f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-quobyte-6129863f-ce79-482d-b856-a969e734b625" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-6129863f-ce79-482d-b856-a969e734b625" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Acquiring lock "cinder-quobyte-0c39b5ad-7f76-4a0c-ab64-1eca9250497f" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[97991d1c-ba79-4c27-9547-aa635c23818d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Lock "cinder-quobyte-0c39b5ad-7f76-4a0c-ab64-1eca9250497f" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daa4ddc-a3f7-4eed-9b30-e65d261bfe17]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:57 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.750s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:31:57 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Deleted volume successfully. Jul 08 18:31:57 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 Jul 08 18:31:57 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c6b21431-f706-43ee-8b08-23644e5d15fe tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-c1a4f8af-9e27-4677-9929-caf6fbd8b775-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:57 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f Jul 08 18:31:57 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:58 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625" returned: 0 in 0.806s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:58 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625 Jul 08 18:31:58 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:58 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f" returned: 0 in 0.948s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:58 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f Jul 08 18:31:58 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:58 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-6129863f-ce79-482d-b856-a969e734b625" returned: 0 in 0.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-6129863f-ce79-482d-b856-a969e734b625" released by "delete_volume" :: held 1.565s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Created reservations ['19c53b4e-eee9-44fa-a85e-2dce7f1cbef2', 'aa6209c0-3df2-4e69-9f1d-3ee4d73f3edc', 'd7cf0dd6-2700-4e85-b201-ba7de8228953', '33b1227d-abea-4aef-a82d-94a3acd2a482'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:58 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:58 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:31:58 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0c39b5ad-7f76-4a0c-ab64-1eca9250497f" returned: 0 in 0.695s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Lock "cinder-quobyte-0c39b5ad-7f76-4a0c-ab64-1eca9250497f" released by "delete_volume" :: held 1.692s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Created reservations ['1d5f65de-1c36-4d41-8434-a5a30c6668d4', 'c0e52ebb-0a32-480b-b73a-9f6099c33d43', '64de13b6-0669-4cd3-8f7a-33a8c967fd45', '8fd488cc-1f62-4889-8728-cce472b511ae'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:59 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:31:59 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-quobyte-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef" acquired by "delete_volume" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b265a-9228-49e8-9ab1-0cac23344ed4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:31:59 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef Jul 08 18:31:59 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:31:59 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.944s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:31:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Deleted volume successfully. Jul 08 18:31:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-524af0ac-8134-4630-a3c4-243e9a87d62e tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-6129863f-ce79-482d-b856-a969e734b625-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:00 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Flow 'volume_create_manager' (d8ee86dd-4ac1-488c-924a-4b874c3efcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6051df37-2fd3-4d77-88b7-06b13000abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.940s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Deleted volume successfully. Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6051df37-2fd3-4d77-88b7-06b13000abce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494091004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93323d4-6a69-49ae-8483-051779f7e0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8273755bf6a24acd88f7502b5fd13caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:00Z,use_quota=True,user_id='1c955bc8a46d4b4a983778770fd5b537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fe6487-887b-4388-8bfa-87fbab9086ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fe6487-887b-4388-8bfa-87fbab9086ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c72ba81-f5ba-4612-bc12-e6d95e9d7ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c72ba81-f5ba-4612-bc12-e6d95e9d7ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93323d4-6a69-49ae-8483-051779f7e0f1', 'volume_name': 'volume-c93323d4-6a69-49ae-8483-051779f7e0f1', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0664ae8-2fc0-4bde-b196-6e7488ab33b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0664ae8-2fc0-4bde-b196-6e7488ab33b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4198608a-e3c9-4c54-bebb-89dfd0a768eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:00 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Volume c93323d4-6a69-49ae-8483-051779f7e0f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93323d4-6a69-49ae-8483-051779f7e0f1', 'volume_size': 1} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1494091004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93323d4-6a69-49ae-8483-051779f7e0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8273755bf6a24acd88f7502b5fd13caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:00Z,use_quota=True,user_id='1c955bc8a46d4b4a983778770fd5b537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Creating volume c93323d4-6a69-49ae-8483-051779f7e0f1 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:00 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cc0ae23d-3889-41fa-9032-ca9c5a0f3812 tempest-ProjectReaderTests-1404347013 None] Lock "cinder-0c39b5ad-7f76-4a0c-ab64-1eca9250497f-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:00 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 1073741824 Jul 08 18:32:00 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:00 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef" returned: 0 in 0.919s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:00 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef Jul 08 18:32:00 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:00 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 1073741824" returned: 0 in 0.870s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:01 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 Jul 08 18:32:01 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:01 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef" returned: 0 in 0.701s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef" released by "delete_volume" :: held 1.684s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created reservations ['ae3b94de-c834-47f5-9f95-18e5900abffe', '18745fa4-75e6-43b0-9db8-d9b6cd5db34f', 'fd91e918-00b2-483f-a66a-277df4ba8c3d', '8582a34c-69e8-40bb-993e-c329c537429e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:01 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:01 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-quobyte-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:01 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1" returned: 0 in 0.780s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4198608a-e3c9-4c54-bebb-89dfd0a768eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93323d4-6a69-49ae-8483-051779f7e0f1', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaf89ec-3165-4779-ac3d-77192bbb4084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51f1086-2c82-4ecc-95d7-18c8f28e9a42]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:01 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Volume volume-c93323d4-6a69-49ae-8483-051779f7e0f1 (c93323d4-6a69-49ae-8483-051779f7e0f1): created successfully Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcaf89ec-3165-4779-ac3d-77192bbb4084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Flow 'volume_create_manager' (d8ee86dd-4ac1-488c-924a-4b874c3efcf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-acf5c24e-ae99-43e5-93ad-4082eda0ff73 tempest-ProjectReaderTests-1404347013 None] Created volume successfully. Jul 08 18:32:01 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c Jul 08 18:32:01 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:02 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.713s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:02 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Deleted volume successfully. Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-cb66f4d4-bcbb-4eba-b4ac-a3bc6462c049 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-4d7efc8c-84db-41c7-87d5-30c91f3ed7ef-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Acquiring lock "cinder-c93323d4-6a69-49ae-8483-051779f7e0f1-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Lock "cinder-c93323d4-6a69-49ae-8483-051779f7e0f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Acquiring lock "cinder-quobyte-c93323d4-6a69-49ae-8483-051779f7e0f1" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Lock "cinder-quobyte-c93323d4-6a69-49ae-8483-051779f7e0f1" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ac6c5f-1ff9-461b-9f67-f6aa2198a342]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:02 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 Jul 08 18:32:02 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:02 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:02 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:02 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c" returned: 0 in 0.860s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:02 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c Jul 08 18:32:02 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:03 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1" returned: 0 in 0.807s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:03 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.720s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:32:03 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1 Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:32:03 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:03 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c" returned: 0 in 0.726s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c" released by "delete_volume" :: held 1.650s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created reservations ['def982dd-5ab5-456d-a1cc-2d8421163ff6', '38fe9abc-0486-49c6-b025-d3825ca2db53', '3bfa3d18-be5a-4a68-8cd9-957fc254547a', '4ce89f3e-3037-4197-9b42-393cbd7fe0c7'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:03 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:03 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:03 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c93323d4-6a69-49ae-8483-051779f7e0f1" returned: 0 in 0.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Lock "cinder-quobyte-c93323d4-6a69-49ae-8483-051779f7e0f1" released by "delete_volume" :: held 1.564s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Created reservations ['7dcdb3bc-5a54-4368-a70b-b8c64c38a447', '9ff356aa-dc97-47b8-b5c3-42700c8e8bfa', 'bcae8074-a234-40cb-9b77-34b1da3e3c68', 'd384f97e-40be-4f7f-a548-140d2905dd54'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:04 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:04 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-quobyte-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cefd386-5378-46d0-9095-191ba18f28a0]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:04 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 Jul 08 18:32:04 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:04 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.719s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Deleted volume successfully. Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-63364627-2443-41a0-acb1-220a5cf6a803 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-3fa543ca-f23c-4b2c-80c0-cfd936c01d5c-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:04 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.767s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Deleted volume successfully. Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1e11b22c-0c73-4ea0-8604-98517fb8f5fa tempest-ProjectReaderTests-1404347013 None] Lock "cinder-c93323d4-6a69-49ae-8483-051779f7e0f1-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:04 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45" returned: 0 in 0.856s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:04 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45 Jul 08 18:32:04 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:05 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45" returned: 0 in 0.715s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45" released by "delete_volume" :: held 1.622s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created reservations ['cd0071f8-f870-43ad-a3dd-6c73f1f2253d', '8663b490-8214-4ce0-9835-30f9d7cfd664', '743c9e4d-4cc6-4a47-b18b-4a10430af320', '68c7f664-5b7d-4d7a-877e-929b4885321c'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:05 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:05 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-5a3eb960-49c0-45f1-baab-6992eed658a5-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-5a3eb960-49c0-45f1-baab-6992eed658a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-quobyte-ea9bff35-04a0-4c8a-9047-bb1d305db746" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-ea9bff35-04a0-4c8a-9047-bb1d305db746" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-quobyte-5a3eb960-49c0-45f1-baab-6992eed658a5" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-5a3eb960-49c0-45f1-baab-6992eed658a5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Deleting offline snapshot 5a3eb960-49c0-45f1-baab-6992eed658a5 of volume ea9bff35-04a0-4c8a-9047-bb1d305db746 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] snapshot_file for this snap is: volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d1e93-9731-42fd-8876-8d04a81d25e8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:06 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 Jul 08 18:32:06 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:06 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.775s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:06 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Deleted volume successfully. Jul 08 18:32:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ccd04450-a153-4e6a-8aad-b817e0fbc6c6 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-952f5b11-6dd1-4c2d-ad0e-686d5c6daa45-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:07 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5" returned: 0 in 0.793s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea9bff35-04a0-4c8a-9047-bb1d305db746(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:32:07 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7011d7-92d3-4abb-b3cd-ecb3b3a66cef]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:07 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 Jul 08 18:32:07 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:07 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746" returned: 0 in 0.774s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:07 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 Jul 08 18:32:07 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:08 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5" returned: 0 in 0.721s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:08 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5 Jul 08 18:32:08 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:09 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746.5a3eb960-49c0-45f1-baab-6992eed658a5" returned: 0 in 0.632s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-5a3eb960-49c0-45f1-baab-6992eed658a5" released by "_delete_snapshot" :: held 3.050s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-ea9bff35-04a0-4c8a-9047-bb1d305db746" released by "delete_snapshot" :: held 3.074s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:09 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created reservations ['44946747-fa43-4eb2-a441-2bbbd009cf83', '7f71075d-87a9-4b44-9b04-5109303ab2cf', '9094fa8f-2f59-4001-8d19-a401a1652bdc', 'c168ab40-16a0-4a10-85e4-a24df32293ba'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Delete snapshot completed successfully. Jul 08 18:32:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0bfad707-1f40-40e5-9a37-f52c28eabdb5 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-5a3eb960-49c0-45f1-baab-6992eed658a5-delete_snapshot" released by "delete_snapshot" :: held 3.203s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-ea9bff35-04a0-4c8a-9047-bb1d305db746-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-ea9bff35-04a0-4c8a-9047-bb1d305db746-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "cinder-quobyte-ea9bff35-04a0-4c8a-9047-bb1d305db746" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-ea9bff35-04a0-4c8a-9047-bb1d305db746" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac1e3e2-e07e-4489-8ede-6b86790092d5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:10 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 Jul 08 18:32:10 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:11 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746" returned: 0 in 0.728s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:11 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746 Jul 08 18:32:11 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:11 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-ea9bff35-04a0-4c8a-9047-bb1d305db746" returned: 0 in 0.642s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-quobyte-ea9bff35-04a0-4c8a-9047-bb1d305db746" released by "delete_volume" :: held 1.428s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Created reservations ['969f8b5e-4ef7-4dab-8c33-3e9bb7779811', 'c03f4a05-cfb4-45ba-9af4-7ac5940ca9b5', '94c9e96f-b693-4a0c-8796-87d62e04074b', '7158fc2e-8ae6-4b21-9c33-2e1853d8a9f9'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:12 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:12 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:12 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.631s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Deleted volume successfully. Jul 08 18:32:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-08b11083-5850-4b98-9a91-7d7f77e83a33 tempest-CreateVolumesFromSnapshotTest-241245498 None] Lock "cinder-ea9bff35-04a0-4c8a-9047-bb1d305db746-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:22 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=85,cinder:INSERT=32,cinder:UPDATE=115,cinder:DELETE=7 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:32:22 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=83,cinder:UPDATE=116,cinder:INSERT=32,cinder:DELETE=13 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (ab3d175d-4e88-4406-b1c0-7b367623bfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b442c869-15d1-4f60-b786-c7d7c1521ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Flow 'volume_create_manager' (0f40e719-5122-459e-9716-6a7ec4142511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db83fa50-dbdb-4699-9c85-5de2c9c66390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b442c869-15d1-4f60-b786-c7d7c1521ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1660705701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43b1df0-2274-4c4e-b1fe-22cafcc28510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:29Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3495a99e-17ed-4e16-8942-308c4dd624de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3495a99e-17ed-4e16-8942-308c4dd624de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea055b4-0838-46bf-b2ff-7a13289b1aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea055b4-0838-46bf-b2ff-7a13289b1aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43b1df0-2274-4c4e-b1fe-22cafcc28510', 'volume_name': 'volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12aeccca-2be3-4c74-a168-238aac0dbeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12aeccca-2be3-4c74-a168-238aac0dbeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7295c70c-1b02-4a30-a127-f8b502eb525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Volume e43b1df0-2274-4c4e-b1fe-22cafcc28510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510', 'volume_size': 1} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1660705701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43b1df0-2274-4c4e-b1fe-22cafcc28510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:29Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Creating volume e43b1df0-2274-4c4e-b1fe-22cafcc28510 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:29 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db83fa50-dbdb-4699-9c85-5de2c9c66390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b71f46-8627-4cd6-b096-bc200db8377c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e12edff79a4825b1692528f448c8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:29Z,use_quota=True,user_id='82e188cce0ea45d4af69fb22af6022de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fa5b41-b89e-4633-896b-12aea2abbca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60fa5b41-b89e-4633-896b-12aea2abbca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa558a8-0dfc-4061-bca3-85c608f62ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 1073741824 Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa558a8-0dfc-4061-bca3-85c608f62ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b71f46-8627-4cd6-b096-bc200db8377c', 'volume_name': 'volume-f4b71f46-8627-4cd6-b096-bc200db8377c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a73dc63-9d68-4171-b2e7-f9d3912c501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a73dc63-9d68-4171-b2e7-f9d3912c501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f3fbb8-2cf3-4b96-a875-f0418c5a2612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Volume f4b71f46-8627-4cd6-b096-bc200db8377c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b71f46-8627-4cd6-b096-bc200db8377c', 'volume_size': 1} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (7a023f53-4452-486e-affd-a99b0a62f797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c918617b-d13b-49b7-a55b-b8a8252a0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c918617b-d13b-49b7-a55b-b8a8252a0da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732228053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df79888a-67b6-496f-ba1a-5794365e6de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:29Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad28a04-443e-4ded-9694-ffa1fc93efd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad28a04-443e-4ded-9694-ffa1fc93efd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a80147-8655-4275-9bbf-353cc1ad0540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a80147-8655-4275-9bbf-353cc1ad0540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df79888a-67b6-496f-ba1a-5794365e6de0', 'volume_name': 'volume-df79888a-67b6-496f-ba1a-5794365e6de0', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429152ea-89c2-47dc-ad3b-5dd39beb1153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429152ea-89c2-47dc-ad3b-5dd39beb1153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1965c8-7650-49b8-87dd-e0702c6ac75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:29 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Volume df79888a-67b6-496f-ba1a-5794365e6de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df79888a-67b6-496f-ba1a-5794365e6de0', 'volume_size': 1} Jul 08 18:32:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (28b67e01-9521-4e80-b2b0-42940cde5ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d26f2b-0028-40ce-b2fd-a99b40c8616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d26f2b-0028-40ce-b2fd-a99b40c8616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902963016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3301fa73-3abe-429e-81e8-22337c440b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:30Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c49f6f-9b79-4a1e-a7da-309d1bc708c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c49f6f-9b79-4a1e-a7da-309d1bc708c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7670fa-ad27-4e44-983f-b6ed7df2301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7670fa-ad27-4e44-983f-b6ed7df2301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3301fa73-3abe-429e-81e8-22337c440b6e', 'volume_name': 'volume-3301fa73-3abe-429e-81e8-22337c440b6e', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5685b5ad-1ccb-4211-9d03-1513bfa75901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5685b5ad-1ccb-4211-9d03-1513bfa75901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8810bc5-0d40-4268-95c3-fab3f33b85e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Volume 3301fa73-3abe-429e-81e8-22337c440b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3301fa73-3abe-429e-81e8-22337c440b6e', 'volume_size': 1} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b8613976-aa3e-4b57-bcb2-e5524f0a07a2 tempest-ProjectAdminTests-1285676246 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87309) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (db8da862-6e3e-49b3-af1c-e64627e83ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c184773-b552-4c0a-a769-ef607d9b0263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c184773-b552-4c0a-a769-ef607d9b0263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-252301080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0993b5d8-dee9-43f6-a96b-a2eda699ce0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:30Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def1ce7a-83e9-4389-ab97-994caffc4e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def1ce7a-83e9-4389-ab97-994caffc4e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0268ccad-4ca6-4c50-8193-5ffd6c25834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0268ccad-4ca6-4c50-8193-5ffd6c25834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0993b5d8-dee9-43f6-a96b-a2eda699ce0d', 'volume_name': 'volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474cb81-ca37-43ec-883c-942532977e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474cb81-ca37-43ec-883c-942532977e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dbb309-afae-4b7f-add2-4da4f43e8ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:30 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Volume 0993b5d8-dee9-43f6-a96b-a2eda699ce0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d', 'volume_size': 1} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 1073741824" returned: 0 in 1.129s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:30 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 Jul 08 18:32:30 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (6316fe27-c5f5-41ed-97fa-3ff097ba77b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:30 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0c5e7e-f718-4a06-b9b7-55ecc53fe80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0c5e7e-f718-4a06-b9b7-55ecc53fe80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878002756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781ed601-582c-4f64-9791-3921ca84a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:31Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c876449-84a3-49a1-b973-33276edac111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c876449-84a3-49a1-b973-33276edac111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa470f0-2169-4562-9584-3ac9562a351f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa470f0-2169-4562-9584-3ac9562a351f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781ed601-582c-4f64-9791-3921ca84a327', 'volume_name': 'volume-781ed601-582c-4f64-9791-3921ca84a327', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae1b2e2-5932-4a67-adc6-8633cb1bcdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae1b2e2-5932-4a67-adc6-8633cb1bcdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e83426d-8af2-4050-95ba-198f9b442a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:31 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Volume 781ed601-582c-4f64-9791-3921ca84a327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781ed601-582c-4f64-9791-3921ca84a327', 'volume_size': 1} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:31 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510" returned: 0 in 0.701s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b71f46-8627-4cd6-b096-bc200db8377c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e12edff79a4825b1692528f448c8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:29Z,use_quota=True,user_id='82e188cce0ea45d4af69fb22af6022de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Creating volume f4b71f46-8627-4cd6-b096-bc200db8377c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:31 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7295c70c-1b02-4a30-a127-f8b502eb525e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b748ce-df67-45e8-9ad2-6a7e2b807e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:31 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c 1073741824 Jul 08 18:32:31 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:31 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Volume volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 (e43b1df0-2274-4c4e-b1fe-22cafcc28510): created successfully Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b748ce-df67-45e8-9ad2-6a7e2b807e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (ab3d175d-4e88-4406-b1c0-7b367623bfb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9c53fd6b-cfda-4772-bc87-903f3215eeb4 tempest-CreateVolumesFromImageTest-1592814650 None] Created volume successfully. Jul 08 18:32:32 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c 1073741824" returned: 0 in 0.958s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:32 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c Jul 08 18:32:32 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:33 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c" returned: 0 in 0.766s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.476s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732228053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df79888a-67b6-496f-ba1a-5794365e6de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:29Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Creating volume df79888a-67b6-496f-ba1a-5794365e6de0 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:33 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f3fbb8-2cf3-4b96-a875-f0418c5a2612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b71f46-8627-4cd6-b096-bc200db8377c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1561f3c4-c20f-440e-aefd-70c458a42bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:33 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Volume volume-f4b71f46-8627-4cd6-b096-bc200db8377c (f4b71f46-8627-4cd6-b096-bc200db8377c): created successfully Jul 08 18:32:33 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 1073741824 Jul 08 18:32:33 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1561f3c4-c20f-440e-aefd-70c458a42bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Flow 'volume_create_manager' (0f40e719-5122-459e-9716-6a7ec4142511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:33 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e1d3400d-024b-4a03-b97a-b3c76f04d087 tempest-CinderUnicodeTest-2109729499 None] Created volume successfully. Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Flow 'volume_create_manager' (9f2c5829-4eee-4aca-ade2-36a37db457c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df535468-edd0-4e67-8fa1-2f71fae27360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df535468-edd0-4e67-8fa1-2f71fae27360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771eeed2-327e-43a4-ab26-7930c77a8643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f303cdb0964204a4aa73c8d9dc466e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:33Z,use_quota=True,user_id='509e9205bfde4a5098a87412f45b81e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(363b43d7-0caf-42dd-a68f-791c51b24fb0),volume_type_id=363b43d7-0caf-42dd-a68f-791c51b24fb0)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6becde-c3d4-4574-934f-4983abbc0201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6becde-c3d4-4574-934f-4983abbc0201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a2ae6f-2d9a-4494-85db-927ca5b08472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a2ae6f-2d9a-4494-85db-927ca5b08472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '771eeed2-327e-43a4-ab26-7930c77a8643', 'volume_name': 'volume-771eeed2-327e-43a4-ab26-7930c77a8643', 'volume_size': 1, 'image_id': '73c87790-96ec-453f-9567-af1adec40a46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73c87790-96ec-453f-9567-af1adec40a46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '551aa9f4c69f0ee1f444631611ad8b91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27f303cdb0964204a4aa73c8d9dc466e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14680d9ca68c4aef201279231c082cace9f6f85de327750bf30fe4a11b166141f84d98a73811af4d27086d37eea99dd68c0f6c8629ebf14de7a24af67e1068d9', 'id': '73c87790-96ec-453f-9567-af1adec40a46', 'created_at': datetime.datetime(2026, 7, 8, 16, 32, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73c87790-96ec-453f-9567-af1adec40a46/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350fcc8d-6fbf-4fe1-8122-5ff1073f258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350fcc8d-6fbf-4fe1-8122-5ff1073f258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7312ee-b348-4ca8-aaee-492deaef7331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:33 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Volume 771eeed2-327e-43a4-ab26-7930c77a8643: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-771eeed2-327e-43a4-ab26-7930c77a8643', 'volume_size': 1, 'image_id': '73c87790-96ec-453f-9567-af1adec40a46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73c87790-96ec-453f-9567-af1adec40a46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '551aa9f4c69f0ee1f444631611ad8b91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27f303cdb0964204a4aa73c8d9dc466e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14680d9ca68c4aef201279231c082cace9f6f85de327750bf30fe4a11b166141f84d98a73811af4d27086d37eea99dd68c0f6c8629ebf14de7a24af67e1068d9', 'id': '73c87790-96ec-453f-9567-af1adec40a46', 'created_at': datetime.datetime(2026, 7, 8, 16, 32, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73c87790-96ec-453f-9567-af1adec40a46/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 18:32:33 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Trying to clone 771eeed2-327e-43a4-ab26-7930c77a8643 from image 73c87790-96ec-453f-9567-af1adec40a46 at location (None, [{'url': 'file:///opt/stack/data/glance/images/73c87790-96ec-453f-9567-af1adec40a46', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:32:34 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[99142a1b-bb5c-462a-8bca-97f4c8558076]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:34 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD Jul 08 18:32:34 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:34 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 1073741824" returned: 0 in 1.087s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:34 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 Jul 08 18:32:34 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Flow 'volume_create_manager' (8b6249c6-2523-4780-8a7a-63dff17acc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc6c80f-86be-49e8-9a31-02ab395c02e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc6c80f-86be-49e8-9a31-02ab395c02e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-216266959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3650d4d-c4bc-4284-a0bb-eae82e3e81a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e12edff79a4825b1692528f448c8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:34Z,use_quota=True,user_id='82e188cce0ea45d4af69fb22af6022de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a8481e-743b-4222-9b56-41ca8b5e0f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a8481e-743b-4222-9b56-41ca8b5e0f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f55ba-6186-4cc0-bee2-1873ece342d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f55ba-6186-4cc0-bee2-1873ece342d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3650d4d-c4bc-4284-a0bb-eae82e3e81a0', 'volume_name': 'volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bd38ce-3ba8-498e-b457-4d06b57307e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bd38ce-3ba8-498e-b457-4d06b57307e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04c37a3-f93b-4017-a5ad-d25081e9c29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:34 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Volume c3650d4d-c4bc-4284-a0bb-eae82e3e81a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0', 'volume_size': 1} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:34 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:35 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD Jul 08 18:32:35 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:35 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0" returned: 0 in 0.675s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.805s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902963016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3301fa73-3abe-429e-81e8-22337c440b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:30Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Creating volume 3301fa73-3abe-429e-81e8-22337c440b6e {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:35 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:35 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e 1073741824 Jul 08 18:32:35 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1965c8-7650-49b8-87dd-e0702c6ac75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df79888a-67b6-496f-ba1a-5794365e6de0', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c608813-e80f-41f8-b0e7-0157dbeebb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:35 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Volume volume-df79888a-67b6-496f-ba1a-5794365e6de0 (df79888a-67b6-496f-ba1a-5794365e6de0): created successfully Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c608813-e80f-41f8-b0e7-0157dbeebb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (7a023f53-4452-486e-affd-a99b0a62f797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a396da18-c9e6-49c4-89b2-9c54664e0b45 tempest-CreateVolumesFromImageTest-1592814650 None] Created volume successfully. Jul 08 18:32:35 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD" returned: 1 in 0.786s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Temporary image 73c87790-96ec-453f-9567-af1adec40a46 is fetched for user 509e9205bfde4a5098a87412f45b81e2. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf9a509-af47-461e-89c5-8250294957a7]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:35 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD Jul 08 18:32:35 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:36 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e 1073741824" returned: 0 in 0.928s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:36 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e Jul 08 18:32:36 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:36 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:36 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD Jul 08 18:32:36 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:36 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e" returned: 0 in 0.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.135s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-252301080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0993b5d8-dee9-43f6-a96b-a2eda699ce0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:30Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Creating volume 0993b5d8-dee9-43f6-a96b-a2eda699ce0d {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:36 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8810bc5-0d40-4268-95c3-fab3f33b85e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3301fa73-3abe-429e-81e8-22337c440b6e', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:36 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d 1073741824 Jul 08 18:32:36 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baafa5f6-7e57-4cce-b8e9-9735aafe44f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:36 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Volume volume-3301fa73-3abe-429e-81e8-22337c440b6e (3301fa73-3abe-429e-81e8-22337c440b6e): created successfully Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baafa5f6-7e57-4cce-b8e9-9735aafe44f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:36 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (28b67e01-9521-4e80-b2b0-42940cde5ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7a979c7e-670a-44ba-9028-076fea039032 tempest-CreateVolumesFromImageTest-1592814650 None] Created volume successfully. Jul 08 18:32:37 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD" returned: 1 in 0.803s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:32:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:37 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d 1073741824" returned: 0 in 0.935s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:37 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d Jul 08 18:32:37 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:38 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d" returned: 0 in 0.658s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.386s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1878002756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781ed601-582c-4f64-9791-3921ca84a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e80fa655704e5388c5145abfac374e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:31Z,use_quota=True,user_id='ba50a371acc64e388de52b9573ad444a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Creating volume 781ed601-582c-4f64-9791-3921ca84a327 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:38 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dbb309-afae-4b7f-add2-4da4f43e8ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09e2d8c-4e00-4dc6-8339-1799ccca855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:38 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 1073741824 Jul 08 18:32:38 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Volume volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d (0993b5d8-dee9-43f6-a96b-a2eda699ce0d): created successfully Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09e2d8c-4e00-4dc6-8339-1799ccca855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (db8da862-6e3e-49b3-af1c-e64627e83ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-62bff61c-318f-4a67-823f-a4f81aad1062 tempest-CreateVolumesFromImageTest-1592814650 None] Created volume successfully. Jul 08 18:32:39 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 1073741824" returned: 0 in 0.863s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:39 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 Jul 08 18:32:39 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:40 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327" returned: 0 in 0.684s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.481s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-216266959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3650d4d-c4bc-4284-a0bb-eae82e3e81a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53e12edff79a4825b1692528f448c8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:34Z,use_quota=True,user_id='82e188cce0ea45d4af69fb22af6022de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Creating volume c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:40 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:40 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 1073741824 Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e83426d-8af2-4050-95ba-198f9b442a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781ed601-582c-4f64-9791-3921ca84a327', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:40 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c490f96f-1450-4192-9775-7581561fb9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:40 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Volume volume-781ed601-582c-4f64-9791-3921ca84a327 (781ed601-582c-4f64-9791-3921ca84a327): created successfully Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c490f96f-1450-4192-9775-7581561fb9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Flow 'volume_create_manager' (6316fe27-c5f5-41ed-97fa-3ff097ba77b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-62805141-8dbd-4b0b-8551-6777cf92e70b tempest-CreateVolumesFromImageTest-1592814650 None] Created volume successfully. Jul 08 18:32:40 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 1073741824" returned: 0 in 0.856s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:40 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 Jul 08 18:32:40 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-781ed601-582c-4f64-9791-3921ca84a327-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-781ed601-582c-4f64-9791-3921ca84a327-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-quobyte-781ed601-582c-4f64-9791-3921ca84a327" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-781ed601-582c-4f64-9791-3921ca84a327" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3d9ce3-7752-46e9-94b8-8f1f47bdcd17]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:41 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 Jul 08 18:32:41 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:41 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" returned: 0 in 0.733s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.294s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771eeed2-327e-43a4-ab26-7930c77a8643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f303cdb0964204a4aa73c8d9dc466e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:33Z,use_quota=True,user_id='509e9205bfde4a5098a87412f45b81e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(363b43d7-0caf-42dd-a68f-791c51b24fb0),volume_type_id=363b43d7-0caf-42dd-a68f-791c51b24fb0)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Creating volume 771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:41 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:41 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 1073741824 Jul 08 18:32:41 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04c37a3-f93b-4017-a5ad-d25081e9c29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3117f35-e0b3-4ebe-83f5-34615dc7443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:41 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Volume volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 (c3650d4d-c4bc-4284-a0bb-eae82e3e81a0): created successfully Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3117f35-e0b3-4ebe-83f5-34615dc7443f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Flow 'volume_create_manager' (8b6249c6-2523-4780-8a7a-63dff17acc3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:41 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ee73b6cd-e10c-4278-b1b9-98dd8208f492 tempest-CinderUnicodeTest-2109729499 None] Created volume successfully. Jul 08 18:32:41 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327" returned: 0 in 0.852s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:41 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327 Jul 08 18:32:41 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:42 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 1073741824" returned: 0 in 0.944s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:42 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-781ed601-582c-4f64-9791-3921ca84a327" returned: 0 in 0.722s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-781ed601-582c-4f64-9791-3921ca84a327" released by "delete_volume" :: held 1.619s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:42 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 Jul 08 18:32:42 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Created reservations ['60374743-769c-44ce-9c37-fdd8c7dcd787', 'e8870fa7-f28d-4600-8ef8-6472ee91f61e', '864f989c-5513-42ad-a46d-010b7b9ba049', '0aa13a09-0a21-4a5b-8f25-7eca3ec0b7d8'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:42 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:42 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-0993b5d8-dee9-43f6-a96b-a2eda699ce0d-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-0993b5d8-dee9-43f6-a96b-a2eda699ce0d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-quobyte-0993b5d8-dee9-43f6-a96b-a2eda699ce0d" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-0993b5d8-dee9-43f6-a96b-a2eda699ce0d" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc174c6c-5f2b-4da8-a57d-6e4628c7cc9c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:43 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643" returned: 0 in 0.834s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.358s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Creating offline snapshot 477f9639-152f-471e-8d9a-b2896756ed6b of volume c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Attempting download of 73c87790-96ec-453f-9567-af1adec40a46 ((None, [{'url': 'file:///opt/stack/data/glance/images/73c87790-96ec-453f-9567-af1adec40a46', 'metadata': {}}])) to volume 771eeed2-327e-43a4-ab26-7930c77a8643. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:32:43 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.751s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Deleted volume successfully. Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dddcbe-a7d9-4522-a301-3725ee0d9992]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-4146e082-b2dc-4f04-8b70-f030af2840ee tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-781ed601-582c-4f64-9791-3921ca84a327-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:43 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d Jul 08 18:32:43 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2a7478-01ec-4d72-985c-7a873fdcdd3a]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73c87790-96ec-453f-9567-af1adec40a46_z6fjeggl {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:43 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 Jul 08 18:32:43 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:43 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73c87790-96ec-453f-9567-af1adec40a46_z6fjeggl Jul 08 18:32:43 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:44 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d" returned: 0 in 0.940s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:44 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" returned: 0 in 0.843s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:44 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:44 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d Jul 08 18:32:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73c87790-96ec-453f-9567-af1adec40a46_z6fjeggl" returned: 0 in 0.788s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73c87790-96ec-453f-9567-af1adec40a46_z6fjeggl {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:44 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:44 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b 1G Jul 08 18:32:44 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:44 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73c87790-96ec-453f-9567-af1adec40a46_z6fjeggl Jul 08 18:32:44 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:45 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0993b5d8-dee9-43f6-a96b-a2eda699ce0d" returned: 0 in 0.793s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-0993b5d8-dee9-43f6-a96b-a2eda699ce0d" released by "delete_volume" :: held 1.803s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Created reservations ['71c8ea4e-29ff-4fdf-97bf-73a740483b2f', 'f3853a69-149d-46b4-a7cf-53e6ed8b336b', 'bd70f2af-6e1e-474f-9188-83910fb914be', '8a4c399a-1229-4537-9604-c4a3a82933c8'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:45 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:45 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:45 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73c87790-96ec-453f-9567-af1adec40a46_z6fjeggl" returned: 1 in 0.974s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73c87790-96ec-453f-9567-af1adec40a46_z6fjeggl' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1aaa92-2ee4-4249-88a0-a22ae1cffa6c]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:45 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD Jul 08 18:32:45 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:45 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b 1G" returned: 0 in 1.137s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:45 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b Jul 08 18:32:45 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-3301fa73-3abe-429e-81e8-22337c440b6e-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-3301fa73-3abe-429e-81e8-22337c440b6e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-quobyte-3301fa73-3abe-429e-81e8-22337c440b6e" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-3301fa73-3abe-429e-81e8-22337c440b6e" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c9def-8799-4c7e-bcf6-4b21e807756f]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:46 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e Jul 08 18:32:46 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:46 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.825s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Deleted volume successfully. Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-481bb81b-946f-4ee3-8250-6ec5d5fcb778 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-0993b5d8-dee9-43f6-a96b-a2eda699ce0d-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:46 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD" returned: 0 in 0.999s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:46 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b" returned: 0 in 0.968s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:46 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b is being set with open permissions: ugo+rw Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:46 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD Jul 08 18:32:46 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:46 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b Jul 08 18:32:46 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:46 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e" returned: 0 in 1.143s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:47 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e Jul 08 18:32:47 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:47 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b" returned: 0 in 0.750s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:47 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD" returned: 1 in 0.930s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] 73c87790-96ec-453f-9567-af1adec40a46 was raw, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:47 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.info Jul 08 18:32:47 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:47 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 Jul 08 18:32:47 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:47 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3301fa73-3abe-429e-81e8-22337c440b6e" returned: 0 in 0.778s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-3301fa73-3abe-429e-81e8-22337c440b6e" released by "delete_volume" :: held 1.998s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Created reservations ['eff29476-0a25-4b71-808a-766d2b0ab8a2', 'd17edeef-38fb-4814-85d0-922ed924d814', '7cefb202-33bc-437b-ab6b-e6972569f0bd', '0b3a0e24-ed2f-409a-8a6f-399a293ec0d0'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:48 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:48 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:48 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.info" returned: 0 in 0.814s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:48 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.info is being set with open permissions: ugo+rw Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:48 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.info Jul 08 18:32:48 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:48 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643" returned: 0 in 0.890s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73c87790-96ec-453f-9567-af1adec40a46_kich8kcvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:32:48 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:48 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 1G Jul 08 18:32:48 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:48 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.748s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:48 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Deleted volume successfully. Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-ea06bde4-e1bf-40a9-bfeb-abbed649a723 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-3301fa73-3abe-429e-81e8-22337c440b6e-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:48 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.info" returned: 0 in 0.686s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.353s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:48 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f2e9fc58-8785-4320-8b27-90a54db60259 tempest-CinderUnicodeTest-2109729499 None] Create snapshot completed successfully Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-df79888a-67b6-496f-ba1a-5794365e6de0-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-df79888a-67b6-496f-ba1a-5794365e6de0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-quobyte-df79888a-67b6-496f-ba1a-5794365e6de0" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:49 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 1G" returned: 0 in 0.860s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-df79888a-67b6-496f-ba1a-5794365e6de0" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f70f71-789e-4934-8fe1-d3c741ce9870]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[daffd92b-c0a6-48b4-8d4a-e8081ae279b0]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:49 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 Jul 08 18:32:49 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:49 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 Jul 08 18:32:49 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "cinder-477f9639-152f-471e-8d9a-b2896756ed6b-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-477f9639-152f-471e-8d9a-b2896756ed6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "cinder-quobyte-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-quobyte-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "cinder-quobyte-477f9639-152f-471e-8d9a-b2896756ed6b" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-quobyte-477f9639-152f-471e-8d9a-b2896756ed6b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Deleting offline snapshot 477f9639-152f-471e-8d9a-b2896756ed6b of volume c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] snapshot_file for this snap is: volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[656f28b9-56e0-41b9-bd50-1b9462b391c4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Flow 'volume_create_manager' (8950bc0d-6cea-4829-aea7-5a7b4e754a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fd3eb1-75ff-4292-89e0-a1819b7ae45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fd3eb1-75ff-4292-89e0-a1819b7ae45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780423905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1987de-1b35-4072-878d-49057308ead8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1542c1687146a1b2378c2932c86638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:50Z,use_quota=True,user_id='935866f29d994f718f89b67435e222c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9346da9-9e68-4e6a-9c5b-969be42eda59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9346da9-9e68-4e6a-9c5b-969be42eda59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33827568-e31e-4659-8808-24d560bdf454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:49 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b Jul 08 18:32:49 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33827568-e31e-4659-8808-24d560bdf454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1987de-1b35-4072-878d-49057308ead8', 'volume_name': 'volume-fa1987de-1b35-4072-878d-49057308ead8', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475b4d13-da11-4dad-b0cb-e94a5f6ade16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475b4d13-da11-4dad-b0cb-e94a5f6ade16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ffc254-c8b8-4328-a5d2-e2fdb3edb829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:49 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Volume fa1987de-1b35-4072-878d-49057308ead8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1987de-1b35-4072-878d-49057308ead8', 'volume_size': 1} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780423905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1987de-1b35-4072-878d-49057308ead8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1542c1687146a1b2378c2932c86638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:50Z,use_quota=True,user_id='935866f29d994f718f89b67435e222c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Creating volume fa1987de-1b35-4072-878d-49057308ead8 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:49 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:50 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 1073741824 Jul 08 18:32:50 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:50 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0" returned: 0 in 0.911s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:50 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643" returned: 0 in 0.939s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:50 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0 Jul 08 18:32:50 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:50 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 Jul 08 18:32:50 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:50 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b" returned: 0 in 0.979s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b88720-7146-4f44-bcdf-560a0cc7e5bf]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:50 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-df79888a-67b6-496f-ba1a-5794365e6de0" returned: 0 in 0.822s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-df79888a-67b6-496f-ba1a-5794365e6de0" released by "delete_volume" :: held 1.800s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:50 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 Jul 08 18:32:50 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:50 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 1073741824" returned: 0 in 0.995s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:51 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Created reservations ['3b0b89b4-2f89-440d-849f-de9506199f3d', '7d413266-0fc9-4a07-b5e0-e3c56afe1b06', '58abece5-847a-4c6d-9c70-f12926ab8371', 'ca389f99-5e2f-4df1-9590-37cae8a117bf'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643" returned: 1 in 0.902s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Downloaded image 73c87790-96ec-453f-9567-af1adec40a46 ((None, [{'url': 'file:///opt/stack/data/glance/images/73c87790-96ec-453f-9567-af1adec40a46', 'metadata': {}}])) to volume 771eeed2-327e-43a4-ab26-7930c77a8643 successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Temporary image 73c87790-96ec-453f-9567-af1adec40a46 for user 509e9205bfde4a5098a87412f45b81e2 is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Marking volume 771eeed2-327e-43a4-ab26-7930c77a8643 as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Copying metadata from image 73c87790-96ec-453f-9567-af1adec40a46 to 771eeed2-327e-43a4-ab26-7930c77a8643. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Creating volume glance metadata for volume 771eeed2-327e-43a4-ab26-7930c77a8643 backed by image 73c87790-96ec-453f-9567-af1adec40a46 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '73c87790-96ec-453f-9567-af1adec40a46', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '551aa9f4c69f0ee1f444631611ad8b91', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:51 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 Jul 08 18:32:51 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:51 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:51 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7312ee-b348-4ca8-aaee-492deaef7331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771eeed2-327e-43a4-ab26-7930c77a8643', 'volume_size': 1, 'image_id': '73c87790-96ec-453f-9567-af1adec40a46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73c87790-96ec-453f-9567-af1adec40a46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '551aa9f4c69f0ee1f444631611ad8b91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27f303cdb0964204a4aa73c8d9dc466e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14680d9ca68c4aef201279231c082cace9f6f85de327750bf30fe4a11b166141f84d98a73811af4d27086d37eea99dd68c0f6c8629ebf14de7a24af67e1068d9', 'id': '73c87790-96ec-453f-9567-af1adec40a46', 'created_at': datetime.datetime(2026, 7, 8, 16, 32, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 32, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73c87790-96ec-453f-9567-af1adec40a46/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aa2724-fbd0-4437-9142-4c5d89e63eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:51 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Volume volume-771eeed2-327e-43a4-ab26-7930c77a8643 (771eeed2-327e-43a4-ab26-7930c77a8643): created successfully Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aa2724-fbd0-4437-9142-4c5d89e63eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Flow 'volume_create_manager' (9f2c5829-4eee-4aca-ade2-36a37db457c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-13419396-4bfd-4eca-ab85-e3a3dfc77952 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Created volume successfully. Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-e43b1df0-2274-4c4e-b1fe-22cafcc28510-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-e43b1df0-2274-4c4e-b1fe-22cafcc28510-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "cinder-quobyte-e43b1df0-2274-4c4e-b1fe-22cafcc28510" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-e43b1df0-2274-4c4e-b1fe-22cafcc28510" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef13db44-608c-4393-a0da-cd52996619ae]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:51 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 Jul 08 18:32:51 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:51 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" returned: 0 in 0.888s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:51 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b Jul 08 18:32:51 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Acquiring lock "cinder-771eeed2-327e-43a4-ab26-7930c77a8643-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:51 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "cinder-771eeed2-327e-43a4-ab26-7930c77a8643-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8" returned: 0 in 0.891s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:51 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.841s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ffc254-c8b8-4328-a5d2-e2fdb3edb829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1987de-1b35-4072-878d-49057308ead8', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:51 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d822a8-2483-4702-9a73-235cb299ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Deleted volume successfully. Jul 08 18:32:52 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Volume volume-fa1987de-1b35-4072-878d-49057308ead8 (fa1987de-1b35-4072-878d-49057308ead8): created successfully Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d822a8-2483-4702-9a73-235cb299ef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Flow 'volume_create_manager' (8950bc0d-6cea-4829-aea7-5a7b4e754a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Acquiring lock "cinder-quobyte-771eeed2-327e-43a4-ab26-7930c77a8643" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-1912f462-4bfa-4bc6-aefa-9f15643e477a tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-df79888a-67b6-496f-ba1a-5794365e6de0-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d2ad8879-f9db-46ce-9e26-e07043859645 tempest-ProjectReaderTests-1860956591 None] Created volume successfully. Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "cinder-quobyte-771eeed2-327e-43a4-ab26-7930c77a8643" acquired by "delete_volume" :: waited 0.037s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a94e25-3eef-4cff-bc9f-c7932adb3409]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:52 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 Jul 08 18:32:52 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:52 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510" returned: 0 in 0.963s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:52 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510 Jul 08 18:32:52 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:52 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b" returned: 0 in 0.907s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:52 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b Jul 08 18:32:52 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:52 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643" returned: 0 in 0.810s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:53 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 Jul 08 18:32:53 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:53 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e43b1df0-2274-4c4e-b1fe-22cafcc28510" returned: 0 in 0.727s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-quobyte-e43b1df0-2274-4c4e-b1fe-22cafcc28510" released by "delete_volume" :: held 1.761s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Created reservations ['d575dbc0-b2a2-4104-b0c3-967fc3ccc171', 'faa17230-c320-4b45-b3bf-e4872310b866', '27c75350-c021-4fc7-a8ef-fe164057a246', '99773295-08c6-484e-9b22-df877f6866e0'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Acquiring lock "cinder-fa1987de-1b35-4072-878d-49057308ead8-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Lock "cinder-fa1987de-1b35-4072-878d-49057308ead8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:53 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0.477f9639-152f-471e-8d9a-b2896756ed6b" returned: 0 in 0.759s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:53 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:53 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Acquiring lock "cinder-quobyte-fa1987de-1b35-4072-878d-49057308ead8" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-quobyte-477f9639-152f-471e-8d9a-b2896756ed6b" released by "_delete_snapshot" :: held 3.707s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Lock "cinder-quobyte-fa1987de-1b35-4072-878d-49057308ead8" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-quobyte-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" released by "delete_snapshot" :: held 3.766s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d917b7-8efa-41f0-8dcb-127c3b3cd94d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Created reservations ['b3806d4e-416b-4f6f-9d2f-ff959fe58493', '7e01b3ab-0c68-4d9f-b7a5-0935dfcc033c', '5c53b41b-175d-4322-bd5a-5eafd0a4fc1f', '70c0917f-8270-475c-a42b-d8cb86e3a647'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:53 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Delete snapshot completed successfully. Jul 08 18:32:53 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 Jul 08 18:32:53 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-76c42c58-2b97-4eae-bb09-f15cd177b889 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-477f9639-152f-471e-8d9a-b2896756ed6b-delete_snapshot" released by "delete_snapshot" :: held 4.035s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:53 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643" returned: 1 in 0.991s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:32:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:53 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643 Jul 08 18:32:53 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "cinder-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "cinder-quobyte-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-quobyte-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:54 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.955s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:54 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Deleted volume successfully. Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a541f-4ad7-42e8-9af8-7351d7748620]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-43247e24-0224-4f8b-9765-b7a7c95e76f0 tempest-CreateVolumesFromImageTest-1592814650 None] Lock "cinder-e43b1df0-2274-4c4e-b1fe-22cafcc28510-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:54 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 Jul 08 18:32:54 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:54 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8" returned: 0 in 1.242s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:54 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:54 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8 Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-771eeed2-327e-43a4-ab26-7930c77a8643" returned: 0 in 0.892s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:54 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "cinder-quobyte-771eeed2-327e-43a4-ab26-7930c77a8643" released by "delete_volume" :: held 2.769s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Created reservations ['af8e8d67-b20f-4eaa-a5d2-ff3cc9aeb07a', '505f064b-2701-4de0-8622-84e596209ae0', '9221bb1a-1246-4cbc-bf97-bccacef03ffa', '1e337569-3ae7-425c-8a48-69f23edaecee'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:55 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:55 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:55 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" returned: 0 in 1.120s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:55 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0 Jul 08 18:32:55 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:55 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-fa1987de-1b35-4072-878d-49057308ead8" returned: 0 in 1.009s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Lock "cinder-quobyte-fa1987de-1b35-4072-878d-49057308ead8" released by "delete_volume" :: held 2.329s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:55 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.903s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Created reservations ['c87739d0-3e85-4018-84aa-ab2574b3e0eb', '31bd2449-bf43-4040-916a-15ebe1e36625', '44d30cd8-66b6-4715-a81b-b3dc287b0408', '4268982d-cf08-4e46-ab26-da70d776c8e8'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:55 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Deleted volume successfully. Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-55032b4a-a83f-4848-bb18-5d2a4adcbdd4 tempest-VolumeAndVolumeTypeFromImageTest-1728160278 None] Lock "cinder-771eeed2-327e-43a4-ab26-7930c77a8643-delete_volume" released by "delete_volume" :: held 4.031s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:56 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:56 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:56 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" returned: 0 in 0.917s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-quobyte-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0" released by "delete_volume" :: held 2.148s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Created reservations ['8a401b23-8d1a-4bca-a8be-015c8c6319a0', 'c3a7ce38-0d98-403c-86b9-ddabaf455e7a', '2d1f8c0f-b525-40ff-a133-2801c12b37e6', '6ffc6c51-31dc-4058-9158-11b0f4e7fe4e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:56 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:56 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:56 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.819s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Deleted volume successfully. Jul 08 18:32:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-13f093d1-9df7-4470-854e-549cb08a1719 tempest-ProjectReaderTests-1860956591 None] Lock "cinder-fa1987de-1b35-4072-878d-49057308ead8-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Flow 'volume_create_manager' (6484180e-29ff-4a4f-ad03-e5fa93766a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba98856-4a4b-4805-99c8-806c65fdb388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba98856-4a4b-4805-99c8-806c65fdb388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760306609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e02ca7d-a43f-4778-9117-d1acf3fcf51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1542c1687146a1b2378c2932c86638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:57Z,use_quota=True,user_id='935866f29d994f718f89b67435e222c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9e6ced-c7c2-4d12-a1b7-484d0d56004f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9e6ced-c7c2-4d12-a1b7-484d0d56004f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf821c69-a176-451e-929c-2f1e893961e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf821c69-a176-451e-929c-2f1e893961e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e02ca7d-a43f-4778-9117-d1acf3fcf51e', 'volume_name': 'volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8c36d-2c5e-4e52-a508-277215d792f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8c36d-2c5e-4e52-a508-277215d792f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b05aec-ea38-4fd2-bcf6-9f569a444fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:57 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Volume 7e02ca7d-a43f-4778-9117-d1acf3fcf51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e', 'volume_size': 1} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760306609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e02ca7d-a43f-4778-9117-d1acf3fcf51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1542c1687146a1b2378c2932c86638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:57Z,use_quota=True,user_id='935866f29d994f718f89b67435e222c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Creating volume 7e02ca7d-a43f-4778-9117-d1acf3fcf51e {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:57 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:57 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.952s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:57 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e 1073741824 Jul 08 18:32:57 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:32:57 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Deleted volume successfully. Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-814ba34d-aeae-4206-8335-fa00e918cd68 tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-c3650d4d-c4bc-4284-a0bb-eae82e3e81a0-delete_volume" released by "delete_volume" :: held 3.478s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "cinder-f4b71f46-8627-4cd6-b096-bc200db8377c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-f4b71f46-8627-4cd6-b096-bc200db8377c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "cinder-quobyte-f4b71f46-8627-4cd6-b096-bc200db8377c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-quobyte-f4b71f46-8627-4cd6-b096-bc200db8377c" acquired by "delete_volume" :: waited 0.035s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c01a2c-02e5-41c5-9ada-550aed445146]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:32:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:58 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c Jul 08 18:32:58 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (5bddc563-caaf-430e-952d-4f33888b8a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e29257-f074-49bc-8f60-262b215afe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e29257-f074-49bc-8f60-262b215afe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027569765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e9d5fb-8219-40e1-9db4-c21dfac46564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:58Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3f52da-15ed-425f-a810-2182a1bde13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3f52da-15ed-425f-a810-2182a1bde13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5759d892-7414-4bc2-a672-c96d02bf7abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5759d892-7414-4bc2-a672-c96d02bf7abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e9d5fb-8219-40e1-9db4-c21dfac46564', 'volume_name': 'volume-63e9d5fb-8219-40e1-9db4-c21dfac46564', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08a6415-8097-44a3-8302-98d4d08eb333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08a6415-8097-44a3-8302-98d4d08eb333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3ebb19-0c0c-4f01-a959-0f0f283119bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:58 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume 63e9d5fb-8219-40e1-9db4-c21dfac46564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e9d5fb-8219-40e1-9db4-c21dfac46564', 'volume_size': 1} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:58 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e 1073741824" returned: 0 in 1.149s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:58 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c" returned: 0 in 0.911s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:58 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e Jul 08 18:32:58 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:58 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c Jul 08 18:32:58 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:59 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e" returned: 0 in 0.727s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027569765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e9d5fb-8219-40e1-9db4-c21dfac46564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:32:58Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Creating volume 63e9d5fb-8219-40e1-9db4-c21dfac46564 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:32:59 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:59 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f4b71f46-8627-4cd6-b096-bc200db8377c" returned: 0 in 0.744s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:32:59 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 1073741824 Jul 08 18:32:59 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b05aec-ea38-4fd2-bcf6-9f569a444fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd99fd0-f6bf-4346-8c88-c8c257eef752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-quobyte-f4b71f46-8627-4cd6-b096-bc200db8377c" released by "delete_volume" :: held 1.737s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:32:59 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Volume volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e (7e02ca7d-a43f-4778-9117-d1acf3fcf51e): created successfully Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd99fd0-f6bf-4346-8c88-c8c257eef752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Flow 'volume_create_manager' (6484180e-29ff-4a4f-ad03-e5fa93766a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:32:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e78610f7-82c9-477d-9131-053d4f9a1ad7 tempest-ProjectReaderTests-1860956591 None] Created volume successfully. Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Created reservations ['da29b649-7ea3-43d3-8d17-552c2563f483', '25d428c0-2150-4419-bd12-89cf9cfd2712', 'beebebfe-abce-44e9-94b7-185c08294aae', 'c96ace5e-aea8-4d7a-8674-99147974c104'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:32:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:32:59 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:32:59 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:00 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.744s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Deleted volume successfully. Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-87c515ca-5d09-4239-9359-0d1e1db3d0ad tempest-CinderUnicodeTest-2109729499 None] Lock "cinder-f4b71f46-8627-4cd6-b096-bc200db8377c-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:00 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 1073741824" returned: 0 in 1.113s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Acquiring lock "cinder-7e02ca7d-a43f-4778-9117-d1acf3fcf51e-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Lock "cinder-7e02ca7d-a43f-4778-9117-d1acf3fcf51e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:00 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 Jul 08 18:33:00 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Acquiring lock "cinder-quobyte-7e02ca7d-a43f-4778-9117-d1acf3fcf51e" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Lock "cinder-quobyte-7e02ca7d-a43f-4778-9117-d1acf3fcf51e" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c78d3-95f7-4514-8930-f407218af2f1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:00 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e Jul 08 18:33:00 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:01 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564" returned: 0 in 0.899s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3ebb19-0c0c-4f01-a959-0f0f283119bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e9d5fb-8219-40e1-9db4-c21dfac46564', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d66303a-0bff-48ef-9312-a1efbd624fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:01 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 (63e9d5fb-8219-40e1-9db4-c21dfac46564): created successfully Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d66303a-0bff-48ef-9312-a1efbd624fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (5bddc563-caaf-430e-952d-4f33888b8a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:01 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6b483742-14c6-464c-b891-a55cc744e3f3 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created volume successfully. Jul 08 18:33:01 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e" returned: 0 in 1.000s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:01 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e Jul 08 18:33:01 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (a20c5ffb-52a0-41df-ac0c-747b56082ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f639fb54-59da-4182-863e-aa46212fb4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f639fb54-59da-4182-863e-aa46212fb4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249765728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1933df18-5ff2-41ee-9d27-3dad2df8a2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:02Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c6c764-1da0-4e0d-b952-815c75467d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c6c764-1da0-4e0d-b952-815c75467d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0733c766-c773-4f93-b1df-6c527b1bd651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:01 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0733c766-c773-4f93-b1df-6c527b1bd651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1933df18-5ff2-41ee-9d27-3dad2df8a2d7', 'volume_name': 'volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4079155-0aa3-4661-85e5-c4d7076cba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4079155-0aa3-4661-85e5-c4d7076cba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8b37b3-5c61-4aca-9b56-75abae719871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:02 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume 1933df18-5ff2-41ee-9d27-3dad2df8a2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7', 'volume_size': 1} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249765728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1933df18-5ff2-41ee-9d27-3dad2df8a2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:02Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Creating volume 1933df18-5ff2-41ee-9d27-3dad2df8a2d7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:02 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:02 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 1073741824 Jul 08 18:33:02 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:02 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:02 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:02 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7e02ca7d-a43f-4778-9117-d1acf3fcf51e" returned: 0 in 0.706s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Lock "cinder-quobyte-7e02ca7d-a43f-4778-9117-d1acf3fcf51e" released by "delete_volume" :: held 1.766s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Created reservations ['23dde967-8340-4963-a3d1-9e796874e3e8', '65b69a18-3d3e-46f1-af85-df48087f8660', 'e979099b-c9dc-43bf-b758-853661fe5378', 'fcde5e1e-498d-4b49-a34c-d6cc22ae8424'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:02 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:02 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:03 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 1073741824" returned: 0 in 1.322s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:03 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.990s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:33:03 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 Jul 08 18:33:03 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:03 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.777s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:03 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Deleted volume successfully. Jul 08 18:33:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bc677e3b-195e-4ade-9c6a-cda728296fcf tempest-ProjectReaderTests-1860956591 None] Lock "cinder-7e02ca7d-a43f-4778-9117-d1acf3fcf51e-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:04 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7" returned: 0 in 0.746s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.444s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Creating offline snapshot 74e04936-1fc1-4952-9a31-af5880081464 of volume 63e9d5fb-8219-40e1-9db4-c21dfac46564 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8b37b3-5c61-4aca-9b56-75abae719871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9006baa2-b39b-4924-97af-a4b873e4e909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[887b2ec2-9e38-465c-a43e-03694babd552]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:04 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 (1933df18-5ff2-41ee-9d27-3dad2df8a2d7): created successfully Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9006baa2-b39b-4924-97af-a4b873e4e909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (a20c5ffb-52a0-41df-ac0c-747b56082ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7fea5b38-d0e3-4721-8238-bd6c9dd40898 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created volume successfully. Jul 08 18:33:04 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 Jul 08 18:33:04 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (757615e0-1933-43a3-a27a-6432e1d56b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b15cbc5-8c9e-4bd7-99e5-abbc24ce703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b15cbc5-8c9e-4bd7-99e5-abbc24ce703c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1305009150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75e239e-8620-457f-aad0-ba73493f5d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:05Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538bdb11-95eb-4f2b-870e-1d457dffd048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538bdb11-95eb-4f2b-870e-1d457dffd048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1df3bb-ed2b-41da-8707-935c94647b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1df3bb-ed2b-41da-8707-935c94647b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75e239e-8620-457f-aad0-ba73493f5d9c', 'volume_name': 'volume-f75e239e-8620-457f-aad0-ba73493f5d9c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9617c2dd-d0c5-4867-a9d3-0fba0e5fcb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9617c2dd-d0c5-4867-a9d3-0fba0e5fcb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227e78aa-56eb-420d-a9a5-faf777b39033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Volume f75e239e-8620-457f-aad0-ba73493f5d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75e239e-8620-457f-aad0-ba73493f5d9c', 'volume_size': 1} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:05 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564" returned: 0 in 0.908s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:05 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 1G Jul 08 18:33:05 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (4a61f1d7-6311-43da-8af1-06168cf13e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d2e17b-2df7-40b5-92dd-c20dc5937228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d2e17b-2df7-40b5-92dd-c20dc5937228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1499197155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc5186a-0923-4850-8327-0a94128c87e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:06Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2a4d2d-3a71-44ff-8c28-15025857d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2a4d2d-3a71-44ff-8c28-15025857d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f06db54-9c71-49e0-aff9-c8fc0dc44214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f06db54-9c71-49e0-aff9-c8fc0dc44214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc5186a-0923-4850-8327-0a94128c87e5', 'volume_name': 'volume-abc5186a-0923-4850-8327-0a94128c87e5', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceff5bab-8452-4d4a-8456-f592120fb15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceff5bab-8452-4d4a-8456-f592120fb15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3a75f6-8a33-4440-a60b-4f503b750e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume abc5186a-0923-4850-8327-0a94128c87e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc5186a-0923-4850-8327-0a94128c87e5', 'volume_size': 1} Jul 08 18:33:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (ca3e2479-54cc-4b28-8b05-ea80a53a5d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf622b8-b9d6-41d8-8a02-2e751bcf7925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf622b8-b9d6-41d8-8a02-2e751bcf7925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804871966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20930878-99de-47c1-b0f7-790ee5566683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:06Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fda2e91-d84e-4496-8fc8-c68db0a6cccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fda2e91-d84e-4496-8fc8-c68db0a6cccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e57e00-ba63-499b-834f-a3481e78ebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e57e00-ba63-499b-834f-a3481e78ebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20930878-99de-47c1-b0f7-790ee5566683', 'volume_name': 'volume-20930878-99de-47c1-b0f7-790ee5566683', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606cbcf2-6284-4c2e-834e-49eb3f0a8ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606cbcf2-6284-4c2e-834e-49eb3f0a8ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a9bc69-0b75-4685-8463-a2273313938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume 20930878-99de-47c1-b0f7-790ee5566683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20930878-99de-47c1-b0f7-790ee5566683', 'volume_size': 1} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 1G" returned: 0 in 1.014s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:06 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 Jul 08 18:33:06 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (336284b2-dd01-44c2-ac16-251b134344fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8b2853-68e9-4fcf-81a0-2da2f6934ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8b2853-68e9-4fcf-81a0-2da2f6934ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-268681651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46afa90f-a471-4ce0-a980-5316738b85f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:06Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff818d53-9a2d-42d2-812d-6a58c73b2d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff818d53-9a2d-42d2-812d-6a58c73b2d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d54eb12-3942-4cb4-addc-3aeebbffbcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d54eb12-3942-4cb4-addc-3aeebbffbcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46afa90f-a471-4ce0-a980-5316738b85f6', 'volume_name': 'volume-46afa90f-a471-4ce0-a980-5316738b85f6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b19d0b6-5644-4d0e-a903-ff2975c7ca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b19d0b6-5644-4d0e-a903-ff2975c7ca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87b3515-36b4-41c5-9aa7-ee16d199bf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume 46afa90f-a471-4ce0-a980-5316738b85f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46afa90f-a471-4ce0-a980-5316738b85f6', 'volume_size': 1} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (15ac7ca9-37a5-4939-af88-db878f06a381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26a479f-bd9e-4257-bc27-1ee03f0a2ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26a479f-bd9e-4257-bc27-1ee03f0a2ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834032095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f71a0a-46ba-40bf-83cf-421e8e13e643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:07Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b260f9c0-0539-4b2a-9205-5c945eaa5752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b260f9c0-0539-4b2a-9205-5c945eaa5752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661b16fd-ca1f-4a96-92b5-8545bf5cec72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:06 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661b16fd-ca1f-4a96-92b5-8545bf5cec72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f71a0a-46ba-40bf-83cf-421e8e13e643', 'volume_name': 'volume-70f71a0a-46ba-40bf-83cf-421e8e13e643', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274128c3-b68d-4f54-9936-414f03b1bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274128c3-b68d-4f54-9936-414f03b1bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63964c8-5a93-4752-a4bd-fc89f27c4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:07 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume 70f71a0a-46ba-40bf-83cf-421e8e13e643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f71a0a-46ba-40bf-83cf-421e8e13e643', 'volume_size': 1} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:07 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464" returned: 0 in 0.929s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:07 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 is being set with open permissions: ugo+rw Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:07 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 Jul 08 18:33:07 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (06bc39c0-4824-453a-bec4-68615536c965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6c64fb-a226-4f3e-8d00-38a1c6955f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6c64fb-a226-4f3e-8d00-38a1c6955f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1683539756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066bc000-f869-4584-8be1-31adca7d7544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:07Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991567df-19d9-448a-92c3-63fd0e9bfe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991567df-19d9-448a-92c3-63fd0e9bfe45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513be5c2-c181-4674-a2d6-4f395c6a02d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513be5c2-c181-4674-a2d6-4f395c6a02d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066bc000-f869-4584-8be1-31adca7d7544', 'volume_name': 'volume-066bc000-f869-4584-8be1-31adca7d7544', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b087aaa-2638-4416-83be-caaf0c98d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b087aaa-2638-4416-83be-caaf0c98d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eac3ff4-531a-4053-802d-596ca8f73c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:07 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume 066bc000-f869-4584-8be1-31adca7d7544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066bc000-f869-4584-8be1-31adca7d7544', 'volume_size': 1} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:07 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464" returned: 0 in 0.699s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:07 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.info Jul 08 18:33:07 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:08 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.info" returned: 0 in 0.696s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:08 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.info is being set with open permissions: ugo+rw Jul 08 18:33:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:08 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.info Jul 08 18:33:08 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:09 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.info" returned: 0 in 0.659s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.024s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.187s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1305009150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75e239e-8620-457f-aad0-ba73493f5d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:05Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Creating volume f75e239e-8620-457f-aad0-ba73493f5d9c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:09 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:09 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c 1073741824 Jul 08 18:33:09 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0ad6b158-f500-403b-b14e-2619b9676e04 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Create snapshot completed successfully Jul 08 18:33:10 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c 1073741824" returned: 0 in 0.921s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:10 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c Jul 08 18:33:10 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (f1cb9d60-1461-4a9d-94db-ac70a82daa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2708a539-f5ab-4085-8d66-fb3ebf9ff2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2708a539-f5ab-4085-8d66-fb3ebf9ff2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914159655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2159438d-b951-4618-9ad9-a27fc82b41a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:11Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1e08bd-2d46-421b-b201-0a9fcdce20ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1e08bd-2d46-421b-b201-0a9fcdce20ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0b860e-d1f9-4ab8-b4f9-98830252cdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0b860e-d1f9-4ab8-b4f9-98830252cdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2159438d-b951-4618-9ad9-a27fc82b41a6', 'volume_name': 'volume-2159438d-b951-4618-9ad9-a27fc82b41a6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcaf41c-985b-482d-b0fc-1229cc2b5418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcaf41c-985b-482d-b0fc-1229cc2b5418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478957b9-2c20-4d41-8d22-41cf42a30a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:10 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume 2159438d-b951-4618-9ad9-a27fc82b41a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2159438d-b951-4618-9ad9-a27fc82b41a6', 'volume_size': 1} Jul 08 18:33:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:11 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (dcd88fa0-abfc-404b-a6ff-06306715477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfca333-f43f-446a-bbc9-94a8cc4f16ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c" returned: 0 in 0.872s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.349s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1499197155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc5186a-0923-4850-8327-0a94128c87e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:06Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Creating volume abc5186a-0923-4850-8327-0a94128c87e5 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:11 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfca333-f43f-446a-bbc9-94a8cc4f16ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603453642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad1d695-944f-4643-b5b9-761f1ed53127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:11Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061a4f64-d609-4dfb-bc30-8d32f914cf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 1073741824 Jul 08 18:33:11 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061a4f64-d609-4dfb-bc30-8d32f914cf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7f7a1a-ac25-404c-ae44-f79876234e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7f7a1a-ac25-404c-ae44-f79876234e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad1d695-944f-4643-b5b9-761f1ed53127', 'volume_name': 'volume-aad1d695-944f-4643-b5b9-761f1ed53127', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a44e2ee-1dac-4a91-9d15-ab75d2f7c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a44e2ee-1dac-4a91-9d15-ab75d2f7c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796f74f7-7e64-49ec-8348-f04645e2c3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume aad1d695-944f-4643-b5b9-761f1ed53127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad1d695-944f-4643-b5b9-761f1ed53127', 'volume_size': 1} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227e78aa-56eb-420d-a9a5-faf777b39033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75e239e-8620-457f-aad0-ba73493f5d9c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912b2cc0-4b6e-4034-b016-44f72b2119a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Volume volume-f75e239e-8620-457f-aad0-ba73493f5d9c (f75e239e-8620-457f-aad0-ba73493f5d9c): created successfully Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912b2cc0-4b6e-4034-b016-44f72b2119a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (757615e0-1933-43a3-a27a-6432e1d56b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:11 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5e8cb1e2-0979-4ffb-890a-43480fc9b397 tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (92f5b4d7-40f9-4784-bffe-42e0a1e6eb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5e4fd3-ca65-47d5-a99c-9ffd0c375e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5e4fd3-ca65-47d5-a99c-9ffd0c375e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851586061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2d0ec5-4f30-482d-966b-dd36cfa18e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:11Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62df5a59-c166-4341-8f84-030a23e013cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62df5a59-c166-4341-8f84-030a23e013cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344b8007-fab4-43b8-9313-053a3293eb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344b8007-fab4-43b8-9313-053a3293eb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2d0ec5-4f30-482d-966b-dd36cfa18e4f', 'volume_name': 'volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10330810-62ec-4d82-a753-85fd0f9417c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10330810-62ec-4d82-a753-85fd0f9417c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c7aae4-6da4-4d91-a8b3-ba826616d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:11 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume 7a2d0ec5-4f30-482d-966b-dd36cfa18e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f', 'volume_size': 1} Jul 08 18:33:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (b9d4c451-c6eb-448d-8003-43bdf4e30380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62a7f70-3db5-41f7-8561-e404024f12bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62a7f70-3db5-41f7-8561-e404024f12bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-178673335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b52946-1150-44c8-8fa6-b854ffc4e338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:12Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdf85d1-baf7-4368-8554-fe4b05498867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdf85d1-baf7-4368-8554-fe4b05498867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5dd1104-cfc9-439f-91d7-89ed438bda1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5dd1104-cfc9-439f-91d7-89ed438bda1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b52946-1150-44c8-8fa6-b854ffc4e338', 'volume_name': 'volume-77b52946-1150-44c8-8fa6-b854ffc4e338', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959db92c-058e-45c6-8b55-55607a374874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959db92c-058e-45c6-8b55-55607a374874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdde1484-072a-4362-84fd-24360fdf0cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume 77b52946-1150-44c8-8fa6-b854ffc4e338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b52946-1150-44c8-8fa6-b854ffc4e338', 'volume_size': 1} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:12 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 1073741824" returned: 0 in 1.300s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:12 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 Jul 08 18:33:12 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (f09be556-df8d-4e4f-9d8d-4a5aad25816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71074bc6-8c46-4748-a4cf-0627a48e1568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71074bc6-8c46-4748-a4cf-0627a48e1568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1626582859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544dfb9b-096d-442e-bd67-df18a7f79a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:13Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aee71ea-d530-4402-b558-d20cabf29049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aee71ea-d530-4402-b558-d20cabf29049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ac3403-3b7d-49bf-b8ae-91ef4e4985f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ac3403-3b7d-49bf-b8ae-91ef4e4985f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544dfb9b-096d-442e-bd67-df18a7f79a9a', 'volume_name': 'volume-544dfb9b-096d-442e-bd67-df18a7f79a9a', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360e95e8-849b-4ef9-8f30-c92fc868afda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360e95e8-849b-4ef9-8f30-c92fc868afda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a16ed47-4d3a-4bd4-b4c0-1fb7dbc470e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume 544dfb9b-096d-442e-bd67-df18a7f79a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544dfb9b-096d-442e-bd67-df18a7f79a9a', 'volume_size': 1} Jul 08 18:33:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:13 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5" returned: 0 in 0.771s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.038s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804871966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20930878-99de-47c1-b0f7-790ee5566683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:06Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Creating volume 20930878-99de-47c1-b0f7-790ee5566683 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:13 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:13 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 1073741824 Jul 08 18:33:13 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3a75f6-8a33-4440-a60b-4f503b750e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc5186a-0923-4850-8327-0a94128c87e5', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b070840a-4d5f-4182-ad08-eac156fcfec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:13 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume volume-abc5186a-0923-4850-8327-0a94128c87e5 (abc5186a-0923-4850-8327-0a94128c87e5): created successfully Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b070840a-4d5f-4182-ad08-eac156fcfec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (4a61f1d7-6311-43da-8af1-06168cf13e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:13 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b2272e44-e96c-4b50-9c3e-b273fddb89f9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created volume successfully. Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Flow 'volume_create_manager' (5cc92efb-b0fc-4b58-aa94-fb7776637751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbe2eb7-e871-44c9-a8b7-3d21309cfdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbe2eb7-e871-44c9-a8b7-3d21309cfdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264634508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e37ee73-e3b4-4ddb-9811-f46b15bac9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df88dfbf33df4ab7b4fbdd20650ef992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:14Z,use_quota=True,user_id='b52a59ebd65f4034ad01a393f70e444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c838d91-9e06-4a54-b950-1894c0460c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c838d91-9e06-4a54-b950-1894c0460c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610b57cd-cce8-41df-8c25-6db89e636409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610b57cd-cce8-41df-8c25-6db89e636409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e37ee73-e3b4-4ddb-9811-f46b15bac9fa', 'volume_name': 'volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbb2249-875a-41d8-aaa7-419c4b8a9c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbb2249-875a-41d8-aaa7-419c4b8a9c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1262ff98-033d-44d8-865b-1cfefce05a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:13 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Volume 8e37ee73-e3b4-4ddb-9811-f46b15bac9fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa', 'volume_size': 1} Jul 08 18:33:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:14 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 1073741824" returned: 0 in 0.819s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:14 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 Jul 08 18:33:14 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:14 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683" returned: 0 in 0.631s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.105s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-268681651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46afa90f-a471-4ce0-a980-5316738b85f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:06Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Creating volume 46afa90f-a471-4ce0-a980-5316738b85f6 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:14 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:14 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 1073741824 Jul 08 18:33:14 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a9bc69-0b75-4685-8463-a2273313938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20930878-99de-47c1-b0f7-790ee5566683', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65dce82-38d6-4bfc-b670-76a7d9440ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:14 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume volume-20930878-99de-47c1-b0f7-790ee5566683 (20930878-99de-47c1-b0f7-790ee5566683): created successfully Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65dce82-38d6-4bfc-b670-76a7d9440ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (ca3e2479-54cc-4b28-8b05-ea80a53a5d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-73fc8715-6504-4fb4-a603-9fbe3fd2400a tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created volume successfully. Jul 08 18:33:15 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 1073741824" returned: 0 in 0.865s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:15 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 Jul 08 18:33:15 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:16 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6" returned: 0 in 0.627s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.203s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834032095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f71a0a-46ba-40bf-83cf-421e8e13e643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:07Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Creating volume 70f71a0a-46ba-40bf-83cf-421e8e13e643 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:16 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87b3515-36b4-41c5-9aa7-ee16d199bf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46afa90f-a471-4ce0-a980-5316738b85f6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:16 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 1073741824 Jul 08 18:33:16 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd600935-b13a-431f-aa2b-bb0d383445ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:16 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume volume-46afa90f-a471-4ce0-a980-5316738b85f6 (46afa90f-a471-4ce0-a980-5316738b85f6): created successfully Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd600935-b13a-431f-aa2b-bb0d383445ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:16 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (336284b2-dd01-44c2-ac16-251b134344fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:16 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-be5bdd01-3354-40eb-9dea-b7b4885178c9 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created volume successfully. Jul 08 18:33:17 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 1073741824" returned: 0 in 0.839s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:17 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 Jul 08 18:33:17 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:17 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643" returned: 0 in 0.653s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.478s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1683539756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066bc000-f869-4584-8be1-31adca7d7544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb4a1ebb38e473fbb7c9fb1da2921b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:07Z,use_quota=True,user_id='d91cf4b2a507453eac99e0b95ff4fb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Creating volume 066bc000-f869-4584-8be1-31adca7d7544 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:17 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:17 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 1073741824 Jul 08 18:33:17 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63964c8-5a93-4752-a4bd-fc89f27c4046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f71a0a-46ba-40bf-83cf-421e8e13e643', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd800f0-8690-4f1c-b4e7-308190c93541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:17 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 (70f71a0a-46ba-40bf-83cf-421e8e13e643): created successfully Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd800f0-8690-4f1c-b4e7-308190c93541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (15ac7ca9-37a5-4939-af88-db878f06a381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:17 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-8eb44595-245c-4b19-8cec-ecff8104691d tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created volume successfully. Jul 08 18:33:18 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 1073741824" returned: 0 in 0.811s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:18 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 Jul 08 18:33:18 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:19 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544" returned: 0 in 0.622s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.543s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914159655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2159438d-b951-4618-9ad9-a27fc82b41a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:11Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Creating volume 2159438d-b951-4618-9ad9-a27fc82b41a6 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:19 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eac3ff4-531a-4053-802d-596ca8f73c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066bc000-f869-4584-8be1-31adca7d7544', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c690b7c1-4594-41f1-b802-a9ed49a5edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:19 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 1073741824 Jul 08 18:33:19 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:19 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Volume volume-066bc000-f869-4584-8be1-31adca7d7544 (066bc000-f869-4584-8be1-31adca7d7544): created successfully Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c690b7c1-4594-41f1-b802-a9ed49a5edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Flow 'volume_create_manager' (06bc39c0-4824-453a-bec4-68615536c965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:19 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ea4aad67-5e34-49f3-aaf1-47e79f096635 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created volume successfully. Jul 08 18:33:20 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 1073741824" returned: 0 in 0.794s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:20 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 Jul 08 18:33:20 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-066bc000-f869-4584-8be1-31adca7d7544-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-066bc000-f869-4584-8be1-31adca7d7544-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-quobyte-066bc000-f869-4584-8be1-31adca7d7544" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-066bc000-f869-4584-8be1-31adca7d7544" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc558a8-f8b8-4b81-bb5f-20aa88fb8b84]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:20 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 Jul 08 18:33:20 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:20 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6" returned: 0 in 0.674s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.622s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603453642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad1d695-944f-4643-b5b9-761f1ed53127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:11Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Creating volume aad1d695-944f-4643-b5b9-761f1ed53127 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:20 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:20 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 1073741824 Jul 08 18:33:20 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478957b9-2c20-4d41-8d22-41cf42a30a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2159438d-b951-4618-9ad9-a27fc82b41a6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a917b6-7624-4357-8e97-7a614d0553cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:20 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume volume-2159438d-b951-4618-9ad9-a27fc82b41a6 (2159438d-b951-4618-9ad9-a27fc82b41a6): created successfully Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76a917b6-7624-4357-8e97-7a614d0553cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (f1cb9d60-1461-4a9d-94db-ac70a82daa2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:20 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-eabb6e7a-d669-43c9-be17-1a21b8fbef58 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created volume successfully. Jul 08 18:33:21 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544" returned: 0 in 0.823s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:21 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544 Jul 08 18:33:21 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:21 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 1073741824" returned: 0 in 0.910s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:21 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 Jul 08 18:33:21 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:21 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-066bc000-f869-4584-8be1-31adca7d7544" returned: 0 in 0.663s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-066bc000-f869-4584-8be1-31adca7d7544" released by "delete_volume" :: held 1.527s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created reservations ['d518d421-034e-4106-8d44-6edade3d9cb9', 'ab690938-06fc-4a11-92a7-12d8450fe76f', '1f962c11-b57d-4767-b055-0430e1f1ffa7', '86d4d7de-d49c-4691-98a4-16839923683a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:22 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:22 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:22 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127" returned: 0 in 0.656s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.766s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851586061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2d0ec5-4f30-482d-966b-dd36cfa18e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:11Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Creating volume 7a2d0ec5-4f30-482d-966b-dd36cfa18e4f {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:22 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796f74f7-7e64-49ec-8348-f04645e2c3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad1d695-944f-4643-b5b9-761f1ed53127', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:22 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f 1073741824 Jul 08 18:33:22 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1847a5-238e-4fbb-a6c6-e65554ff4293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=109,cinder:UPDATE=163,cinder:INSERT=42,cinder:DELETE=15 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:33:22 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume volume-aad1d695-944f-4643-b5b9-761f1ed53127 (aad1d695-944f-4643-b5b9-761f1ed53127): created successfully Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1847a5-238e-4fbb-a6c6-e65554ff4293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (dcd88fa0-abfc-404b-a6ff-06306715477d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:22 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f8e0ca8d-0fc0-4b3f-987c-e14f3355510e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created volume successfully. Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-70f71a0a-46ba-40bf-83cf-421e8e13e643-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-70f71a0a-46ba-40bf-83cf-421e8e13e643-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-quobyte-70f71a0a-46ba-40bf-83cf-421e8e13e643" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-70f71a0a-46ba-40bf-83cf-421e8e13e643" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b857f9c0-8375-40aa-bdda-e1e6754fa65c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:22 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.707s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:22 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Deleted volume successfully. Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=128,cinder:UPDATE=160,cinder:DELETE=18,cinder:INSERT=38 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:33:22 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-999d3ca3-8ff3-4a29-8470-b65e1d5df9f1 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-066bc000-f869-4584-8be1-31adca7d7544-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:22 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 Jul 08 18:33:22 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:23 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f 1073741824" returned: 0 in 0.865s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:23 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f Jul 08 18:33:23 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:23 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643" returned: 0 in 0.838s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:23 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643 Jul 08 18:33:23 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:23 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f" returned: 0 in 0.649s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.686s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-178673335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b52946-1150-44c8-8fa6-b854ffc4e338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:12Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Creating volume 77b52946-1150-44c8-8fa6-b854ffc4e338 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:23 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:24 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 1073741824 Jul 08 18:33:24 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c7aae4-6da4-4d91-a8b3-ba826616d09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e8dab3-17ef-40d3-80b4-51d783b7e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:24 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f (7a2d0ec5-4f30-482d-966b-dd36cfa18e4f): created successfully Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e8dab3-17ef-40d3-80b4-51d783b7e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (92f5b4d7-40f9-4784-bffe-42e0a1e6eb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:24 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3d1dc66d-8b90-42a3-a1ee-351c63b94e4d tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created volume successfully. Jul 08 18:33:24 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-70f71a0a-46ba-40bf-83cf-421e8e13e643" returned: 0 in 0.678s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-70f71a0a-46ba-40bf-83cf-421e8e13e643" released by "delete_volume" :: held 1.559s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created reservations ['f7dc5552-1a57-4246-83bf-968f2d8aebdf', '90a99a4b-b555-4c3b-8e3d-48e51fd89a5d', '978e8c52-f8a6-491e-9e78-f6a823a8c240', '4350e9bf-4274-4f48-8cb9-f598d7b59e73'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:24 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:24 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-46afa90f-a471-4ce0-a980-5316738b85f6-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-46afa90f-a471-4ce0-a980-5316738b85f6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-quobyte-46afa90f-a471-4ce0-a980-5316738b85f6" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-46afa90f-a471-4ce0-a980-5316738b85f6" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f771fa40-7fba-4f1d-954d-a7e536d7086e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:24 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.645s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:24 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Deleted volume successfully. Jul 08 18:33:24 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 1073741824" returned: 0 in 0.971s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-a736e928-6c34-426e-92c2-a2d85dc4aa8f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-70f71a0a-46ba-40bf-83cf-421e8e13e643-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:24 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 Jul 08 18:33:24 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:25 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 Jul 08 18:33:25 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:25 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338" returned: 0 in 0.636s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.077s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:25 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6" returned: 0 in 0.779s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdde1484-072a-4362-84fd-24360fdf0cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b52946-1150-44c8-8fa6-b854ffc4e338', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56745836-a6ca-4ef9-babc-d225e1cc921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:25 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6 Jul 08 18:33:25 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Creating offline snapshot 82889665-5954-4e28-992c-833a130c0ee8 of volume f75e239e-8620-457f-aad0-ba73493f5d9c {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:33:25 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume volume-77b52946-1150-44c8-8fa6-b854ffc4e338 (77b52946-1150-44c8-8fa6-b854ffc4e338): created successfully Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56745836-a6ca-4ef9-babc-d225e1cc921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (b9d4c451-c6eb-448d-8003-43bdf4e30380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[751cbbc7-93ce-45b1-ab33-c9e6258d811d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:25 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-671cccf6-1eef-49f3-b24a-9b62e435d448 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created volume successfully. Jul 08 18:33:25 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c Jul 08 18:33:25 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:26 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46afa90f-a471-4ce0-a980-5316738b85f6" returned: 0 in 0.624s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-46afa90f-a471-4ce0-a980-5316738b85f6" released by "delete_volume" :: held 1.454s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created reservations ['f17f2f1d-8cae-45d5-be09-f7b70e2e9fb2', 'eeca939e-cfb8-4f40-837f-96846362db0b', '45b51827-1509-49b2-9b97-e929088952a5', '739756c8-c799-4eb2-8644-f33b6fbe97a1'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:26 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:26 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:26 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c" returned: 0 in 0.775s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:26 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 1G Jul 08 18:33:26 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-20930878-99de-47c1-b0f7-790ee5566683-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-20930878-99de-47c1-b0f7-790ee5566683-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-quobyte-20930878-99de-47c1-b0f7-790ee5566683" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:27 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.656s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-20930878-99de-47c1-b0f7-790ee5566683" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:27 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Deleted volume successfully. Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[39828021-e334-443b-af6d-e3bc2d167d76]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e016a8e0-f3b2-44a9-bd77-378dc230a336 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-46afa90f-a471-4ce0-a980-5316738b85f6-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:27 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 Jul 08 18:33:27 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:27 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 1G" returned: 0 in 0.841s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75e239e-8620-457f-aad0-ba73493f5d9c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:27 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75e239e-8620-457f-aad0-ba73493f5d9c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 Jul 08 18:33:27 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:27 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683" returned: 0 in 0.753s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:27 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683 Jul 08 18:33:27 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:27 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75e239e-8620-457f-aad0-ba73493f5d9c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8" returned: 0 in 0.667s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:28 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 is being set with open permissions: ugo+rw Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:28 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 Jul 08 18:33:28 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:28 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-20930878-99de-47c1-b0f7-790ee5566683" returned: 0 in 0.669s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-20930878-99de-47c1-b0f7-790ee5566683" released by "delete_volume" :: held 1.466s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:28 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8" returned: 0 in 0.608s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created reservations ['1b76d135-5fa2-450e-85c5-6be8a2b00bbe', '212d5e9c-28ec-4cd3-8c9d-78da1c7fec2d', 'cc5320f5-b98a-4371-879b-792f7de08990', 'a62d10d0-13a2-4fb8-8dcc-4f87e91cab4e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:28 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.info Jul 08 18:33:28 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:28 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:28 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-abc5186a-0923-4850-8327-0a94128c87e5-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-abc5186a-0923-4850-8327-0a94128c87e5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-quobyte-abc5186a-0923-4850-8327-0a94128c87e5" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:29 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.info" returned: 0 in 0.680s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:29 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.info is being set with open permissions: ugo+rw Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-abc5186a-0923-4850-8327-0a94128c87e5" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:29 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.info Jul 08 18:33:29 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:29 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[310acda0-8dea-42ff-8d5c-f4d60d4ebe72]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.686s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:29 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Deleted volume successfully. Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7020e9bb-8dcd-4d0a-b1b1-fb5a3194600f tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-20930878-99de-47c1-b0f7-790ee5566683-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:29 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 Jul 08 18:33:29 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:29 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.info" returned: 0 in 0.619s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.350s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.320s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1626582859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544dfb9b-096d-442e-bd67-df18a7f79a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3da41509faf4696a3e85eaf79fb8e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:13Z,use_quota=True,user_id='bf117b6fb4fe4215840f94e3e48712f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Creating volume 544dfb9b-096d-442e-bd67-df18a7f79a9a {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:30 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:30 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a 1073741824 Jul 08 18:33:30 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:30 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6c5599f0-e47d-4983-bbe0-239ea7109386 tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:33:30 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5" returned: 0 in 0.841s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:30 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5 Jul 08 18:33:30 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-82889665-5954-4e28-992c-833a130c0ee8-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Lock "cinder-82889665-5954-4e28-992c-833a130c0ee8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-f75e239e-8620-457f-aad0-ba73493f5d9c" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:30 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-abc5186a-0923-4850-8327-0a94128c87e5" returned: 0 in 0.665s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-f75e239e-8620-457f-aad0-ba73493f5d9c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-82889665-5954-4e28-992c-833a130c0ee8" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-abc5186a-0923-4850-8327-0a94128c87e5" released by "delete_volume" :: held 1.562s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-82889665-5954-4e28-992c-833a130c0ee8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot 82889665-5954-4e28-992c-833a130c0ee8 of volume f75e239e-8620-457f-aad0-ba73493f5d9c {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:33:30 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a 1073741824" returned: 0 in 0.961s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab8f39f-7923-4b9e-8a63-ad47aac863bb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created reservations ['a3a07ffc-b415-4e5c-b092-f206135c254f', '94270f6a-3792-4d68-b8f1-a2d6c3e853a8', '37d064ff-c607-4beb-bd72-080d846d80a1', 'ffee9fd6-ff31-448b-b83f-22b403a747a1'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:31 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a Jul 08 18:33:31 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:31 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 Jul 08 18:33:31 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:31 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:31 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-1933df18-5ff2-41ee-9d27-3dad2df8a2d7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-1933df18-5ff2-41ee-9d27-3dad2df8a2d7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "cinder-quobyte-1933df18-5ff2-41ee-9d27-3dad2df8a2d7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-1933df18-5ff2-41ee-9d27-3dad2df8a2d7" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5512778-aa9b-4e4a-a53a-ff16a38d67b9]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:31 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a" returned: 0 in 0.731s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.076s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264634508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e37ee73-e3b4-4ddb-9811-f46b15bac9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df88dfbf33df4ab7b4fbdd20650ef992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:14Z,use_quota=True,user_id='b52a59ebd65f4034ad01a393f70e444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Creating volume 8e37ee73-e3b4-4ddb-9811-f46b15bac9fa {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:31 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:31 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a16ed47-4d3a-4bd4-b4c0-1fb7dbc470e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544dfb9b-096d-442e-bd67-df18a7f79a9a', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:31 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa 1073741824 Jul 08 18:33:31 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83bf98d-dc20-4339-b36c-a206d7f099e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:31 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8" returned: 0 in 0.847s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f75e239e-8620-457f-aad0-ba73493f5d9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:33:31 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:31 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Volume volume-544dfb9b-096d-442e-bd67-df18a7f79a9a (544dfb9b-096d-442e-bd67-df18a7f79a9a): created successfully Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83bf98d-dc20-4339-b36c-a206d7f099e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Flow 'volume_create_manager' (f09be556-df8d-4e4f-9d8d-4a5aad25816a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9221978-c491-404e-a15a-861d92256912]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-18be29d7-3fec-46a5-a679-ffd1a386d7e0 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created volume successfully. Jul 08 18:33:31 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.814s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Deleted volume successfully. Jul 08 18:33:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d58faffe-57c8-4ec8-a5d6-b06f587c2fa8 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-abc5186a-0923-4850-8327-0a94128c87e5-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:32 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c Jul 08 18:33:32 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:32 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7" returned: 0 in 0.873s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:32 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7 Jul 08 18:33:32 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:32 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa 1073741824" returned: 0 in 0.958s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:32 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c" returned: 0 in 0.860s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:32 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 Jul 08 18:33:32 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:32 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa Jul 08 18:33:32 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-544dfb9b-096d-442e-bd67-df18a7f79a9a-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-544dfb9b-096d-442e-bd67-df18a7f79a9a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-quobyte-544dfb9b-096d-442e-bd67-df18a7f79a9a" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-544dfb9b-096d-442e-bd67-df18a7f79a9a" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c11eb-14f8-4cdf-aede-153de28b699e]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:33 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a Jul 08 18:33:33 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:33 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-1933df18-5ff2-41ee-9d27-3dad2df8a2d7" returned: 0 in 0.748s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-quobyte-1933df18-5ff2-41ee-9d27-3dad2df8a2d7" released by "delete_volume" :: held 1.680s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Created reservations ['a6212404-b420-4d37-b091-b5791ba1b478', '00eac77e-afab-42c5-97b9-a32e8fad4f36', '91473699-3e2a-4597-ba1c-f5816e26de96', '29ec209b-045d-4b47-b295-b606e733d164'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:33 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa" returned: 0 in 0.717s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:33 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:33 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1262ff98-033d-44d8-865b-1cfefce05a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328949eb-d9b2-4145-8e40-06f9f0b1d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:33 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Volume volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa (8e37ee73-e3b4-4ddb-9811-f46b15bac9fa): created successfully Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (328949eb-d9b2-4145-8e40-06f9f0b1d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Flow 'volume_create_manager' (5cc92efb-b0fc-4b58-aa94-fb7776637751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:33 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-9b100ed9-4dec-43a4-9e6d-bd6416f5bd1c tempest-ProjectReaderTests-660070546 None] Created volume successfully. Jul 08 18:33:33 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8" returned: 0 in 0.972s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:33 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8 Jul 08 18:33:33 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:33 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a" returned: 0 in 0.867s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:34 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a Jul 08 18:33:34 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Acquiring lock "cinder-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Lock "cinder-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Acquiring lock "cinder-quobyte-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:34 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.855s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Lock "cinder-quobyte-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa" acquired by "delete_volume" :: waited 0.043s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:34 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Deleted volume successfully. Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[17479398-3a0e-4b1d-b087-527bf35910f4]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-f3941948-423f-4847-a88d-569e56e66a64 tempest-CreateVolumesFromSourceVolumeTest-1596611341 None] Lock "cinder-1933df18-5ff2-41ee-9d27-3dad2df8a2d7-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:34 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa Jul 08 18:33:34 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:34 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c.82889665-5954-4e28-992c-833a130c0ee8" returned: 0 in 0.940s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-82889665-5954-4e28-992c-833a130c0ee8" released by "_delete_snapshot" :: held 3.774s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-f75e239e-8620-457f-aad0-ba73493f5d9c" released by "delete_snapshot" :: held 3.808s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Created reservations ['d18d94c4-0e84-4fd5-a880-84b3eb115e56', 'fa661575-5130-4a28-a62b-d3ff6a6c96af', '3390d49d-3809-4f73-837d-5dafa6b71447', 'e0f658a4-46b3-4fa5-abdb-6522d610ecb4'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:34 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:33:34 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-656b2eb1-23fd-4137-81ee-a09a5ffa0347 tempest-ProjectMemberTests-934051372 None] Lock "cinder-82889665-5954-4e28-992c-833a130c0ee8-delete_snapshot" released by "delete_snapshot" :: held 3.981s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-544dfb9b-096d-442e-bd67-df18a7f79a9a" returned: 0 in 0.924s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-544dfb9b-096d-442e-bd67-df18a7f79a9a" released by "delete_volume" :: held 1.851s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created reservations ['4c5484ed-2ff3-4700-9821-9d7bdcff66ad', 'd1216e7f-d21a-4cb7-92bb-f8c126149cad', '68ee6811-1fde-4ca9-9a18-ee1dcb0f0d01', '9ff22566-05e2-4bce-91c8-36dcaee13a6a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:35 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:35 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-77b52946-1150-44c8-8fa6-b854ffc4e338-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-f75e239e-8620-457f-aad0-ba73493f5d9c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-77b52946-1150-44c8-8fa6-b854ffc4e338-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Lock "cinder-f75e239e-8620-457f-aad0-ba73493f5d9c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-quobyte-77b52946-1150-44c8-8fa6-b854ffc4e338" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-f75e239e-8620-457f-aad0-ba73493f5d9c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-77b52946-1150-44c8-8fa6-b854ffc4e338" acquired by "delete_volume" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5978d85c-e9ad-48b8-9d2e-02b45621c45a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-f75e239e-8620-457f-aad0-ba73493f5d9c" acquired by "delete_volume" :: waited 0.048s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:35 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa" returned: 0 in 1.073s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c6775a-dc89-46d6-8f4d-6f09bdf5db1d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:35 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa Jul 08 18:33:35 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:35 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 Jul 08 18:33:35 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:35 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c Jul 08 18:33:35 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:36 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.049s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Deleted volume successfully. Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-c5e15b07-a6bb-4c3a-a3a4-6f3342fa6643 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-544dfb9b-096d-442e-bd67-df18a7f79a9a-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:36 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338" returned: 0 in 1.065s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:36 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa" returned: 0 in 1.024s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:36 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338 Jul 08 18:33:36 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Lock "cinder-quobyte-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa" released by "delete_volume" :: held 2.183s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Created reservations ['534a465d-2536-42b3-ad23-b89829ea7420', '3d29f6ba-f37e-4950-8bc1-7d86b9920348', '5a6071a5-19e2-4b07-bd46-261b75a07c1b', '6cde606f-67dc-492d-ac92-c57a61e18ea3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:36 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c" returned: 0 in 1.097s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:36 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c Jul 08 18:33:36 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:36 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:36 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:37 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-77b52946-1150-44c8-8fa6-b854ffc4e338" returned: 0 in 0.737s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-77b52946-1150-44c8-8fa6-b854ffc4e338" released by "delete_volume" :: held 1.855s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created reservations ['704295ba-4776-46c9-8d65-c2f3a7bee4a9', '9d13106c-cfed-493c-ae33-fa9f0cb900c7', 'fd7c8bb8-0dd3-421d-8859-61d4d42d9b86', '91d7a1fc-a4ef-4914-b430-446c660fb107'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:37 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-f75e239e-8620-457f-aad0-ba73493f5d9c" returned: 0 in 0.804s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-f75e239e-8620-457f-aad0-ba73493f5d9c" released by "delete_volume" :: held 1.986s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:37 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:37 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:37 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.762s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Deleted volume successfully. Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-fcec4db2-8d18-4f63-8943-26dd34700a3e tempest-ProjectReaderTests-660070546 None] Lock "cinder-8e37ee73-e3b4-4ddb-9811-f46b15bac9fa-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Created reservations ['5f426525-0f7b-447a-8497-7877009fa5ee', 'f01a901b-e47a-4163-84e0-09b4d276f1e3', '0ed27232-3783-4c19-a1b1-444fcce9157e', '56aff0a5-1a7e-4901-9155-a17ad46e4afd'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:37 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:37 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-quobyte-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6422ff71-a2cd-486c-9458-f0edcf212915]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:37 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f Jul 08 18:33:37 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Flow 'volume_create_manager' (866dfebb-5c42-43af-863a-1da6afe5a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b80aea-8483-4f56-8dc6-9c7497bbd586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:38 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.936s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Deleted volume successfully. Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b80aea-8483-4f56-8dc6-9c7497bbd586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1906184633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9689e92b-4027-424f-b5b4-b8e633e9932a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df88dfbf33df4ab7b4fbdd20650ef992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:38Z,use_quota=True,user_id='b52a59ebd65f4034ad01a393f70e444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf59083-3807-4f3c-aa73-91502e157cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf59083-3807-4f3c-aa73-91502e157cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea7fe36-905d-44f4-be3b-c195c20e7bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea7fe36-905d-44f4-be3b-c195c20e7bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9689e92b-4027-424f-b5b4-b8e633e9932a', 'volume_name': 'volume-9689e92b-4027-424f-b5b4-b8e633e9932a', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180cd83e-ae34-4774-a654-0fce96d0507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180cd83e-ae34-4774-a654-0fce96d0507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaa0869-d414-48df-89ba-43aceb377dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Volume 9689e92b-4027-424f-b5b4-b8e633e9932a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9689e92b-4027-424f-b5b4-b8e633e9932a', 'volume_size': 1} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1906184633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9689e92b-4027-424f-b5b4-b8e633e9932a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df88dfbf33df4ab7b4fbdd20650ef992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:38Z,use_quota=True,user_id='b52a59ebd65f4034ad01a393f70e444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Creating volume 9689e92b-4027-424f-b5b4-b8e633e9932a {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:38 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:38 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.827s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:38 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a 1073741824 Jul 08 18:33:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:33:38 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b1924b0a-d9a0-4aa8-8332-6b640dc5f27e tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-77b52946-1150-44c8-8fa6-b854ffc4e338-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b58e1d95-71cb-4903-aa19-024b6e4a409c tempest-ProjectMemberTests-934051372 None] Lock "cinder-f75e239e-8620-457f-aad0-ba73493f5d9c-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:38 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f" returned: 0 in 1.130s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:38 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f Jul 08 18:33:38 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (3a28774b-1734-44bf-b9f4-e2291e13ab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1d7ae5-5f63-4f75-be65-9b4189d77d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1d7ae5-5f63-4f75-be65-9b4189d77d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971947213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025dfb9b-122c-45db-b5ea-63aa1db5c4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:39Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2160579f-621d-4ee1-b56d-49508370604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2160579f-621d-4ee1-b56d-49508370604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801330a1-1728-41d9-9579-54d39d699aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801330a1-1728-41d9-9579-54d39d699aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '025dfb9b-122c-45db-b5ea-63aa1db5c4a6', 'volume_name': 'volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1074cb15-546e-4459-bd88-7f4204090b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1074cb15-546e-4459-bd88-7f4204090b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0ff08e-1150-4e0f-bb5e-0c6c0b82094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:39 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Volume 025dfb9b-122c-45db-b5ea-63aa1db5c4a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6', 'volume_size': 1} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:39 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a 1073741824" returned: 0 in 1.112s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:39 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a Jul 08 18:33:39 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:39 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f" returned: 0 in 0.761s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f" released by "delete_volume" :: held 1.937s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created reservations ['75d26656-8ddd-4145-9444-41fcb1cc846d', 'ff03ffa4-78f3-44ef-83cb-968c5ee33b7b', '4e42433a-b2df-45ec-8424-22a79f01895b', 'b668bdce-f089-43eb-bd29-9eae59fdac94'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:39 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:39 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-aad1d695-944f-4643-b5b9-761f1ed53127-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-aad1d695-944f-4643-b5b9-761f1ed53127-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-quobyte-aad1d695-944f-4643-b5b9-761f1ed53127" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-aad1d695-944f-4643-b5b9-761f1ed53127" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[98153acb-cdb9-4325-8729-46c33e388815]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:40 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 Jul 08 18:33:40 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:40 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a" returned: 0 in 0.817s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971947213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025dfb9b-122c-45db-b5ea-63aa1db5c4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:39Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Creating volume 025dfb9b-122c-45db-b5ea-63aa1db5c4a6 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:40 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaa0869-d414-48df-89ba-43aceb377dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9689e92b-4027-424f-b5b4-b8e633e9932a', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884af191-8959-4cfa-945f-2be603e4ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:40 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 1073741824 Jul 08 18:33:40 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:40 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Volume volume-9689e92b-4027-424f-b5b4-b8e633e9932a (9689e92b-4027-424f-b5b4-b8e633e9932a): created successfully Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884af191-8959-4cfa-945f-2be603e4ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Flow 'volume_create_manager' (866dfebb-5c42-43af-863a-1da6afe5a893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-76387286-2c74-4f8b-b82b-32c5833e729e tempest-ProjectReaderTests-660070546 None] Created volume successfully. Jul 08 18:33:40 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.817s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Deleted volume successfully. Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ff6d041-4867-49dd-ad25-ebab5e3dbf39 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-7a2d0ec5-4f30-482d-966b-dd36cfa18e4f-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:40 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127" returned: 0 in 0.927s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:41 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127 Jul 08 18:33:41 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Flow 'volume_create_manager' (65e4641d-d2f1-42f4-a43c-d184b0e1ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead8cddc-3409-40a1-98ee-76787bd6cfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead8cddc-3409-40a1-98ee-76787bd6cfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466b89ae-35a1-4834-ab37-c032e84097cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d0bdfd0be64e79acca5c66116bca08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:41Z,use_quota=True,user_id='99b5e19c4a1c491385382fcefd4a2421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4529655a-517c-4a99-9064-77e8e5d14d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4529655a-517c-4a99-9064-77e8e5d14d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d71b4f8-31f0-479e-90be-7937ab305058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.image.glance [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Creating Keystone auth plugin from conf {{(pid=87309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 18:33:41 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 1073741824" returned: 0 in 1.114s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Acquiring lock "cinder-9689e92b-4027-424f-b5b4-b8e633e9932a-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Lock "cinder-9689e92b-4027-424f-b5b4-b8e633e9932a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:41 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 Jul 08 18:33:41 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Acquiring lock "cinder-quobyte-9689e92b-4027-424f-b5b4-b8e633e9932a" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Lock "cinder-quobyte-9689e92b-4027-424f-b5b4-b8e633e9932a" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6eee7f-5d52-40f9-a7c0-aba1f1875dd5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:41 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-aad1d695-944f-4643-b5b9-761f1ed53127" returned: 0 in 0.839s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:41 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a Jul 08 18:33:41 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-aad1d695-944f-4643-b5b9-761f1ed53127" released by "delete_volume" :: held 1.819s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created reservations ['44e28dec-ee16-4cd1-86c4-2c134f649dac', '8dd7cb8a-532d-4725-bf25-20934fd843ba', '1ea6005f-65ad-4e43-bc23-c084ec2580aa', 'cb4b9371-26c9-4e34-97a5-c8d53ee76865'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d71b4f8-31f0-479e-90be-7937ab305058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '466b89ae-35a1-4834-ab37-c032e84097cc', 'volume_name': 'volume-466b89ae-35a1-4834-ab37-c032e84097cc', 'volume_size': 1, 'image_id': 'fcdfdb20-06bb-4443-a062-13585ee3b408', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fcdfdb20-06bb-4443-a062-13585ee3b408', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c336b67f2aba3eb2d087c60ba774359', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38d0bdfd0be64e79acca5c66116bca08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '29c2b1a9ce631b670fe620c912ef7cbcbc91ce8934a206653d6caaca8ae7ab4df84ef28b71eac4dd9226b8e2719acc443a3f9186511ead6fee4b82e5298b83c7', 'id': 'fcdfdb20-06bb-4443-a062-13585ee3b408', 'created_at': datetime.datetime(2026, 7, 8, 16, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 33, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fcdfdb20-06bb-4443-a062-13585ee3b408/file', 'properties': {}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3b66ab-4699-4b09-8328-b4b6a96b80b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3b66ab-4699-4b09-8328-b4b6a96b80b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92e217d-89ce-4563-bc33-b1b679761d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:41 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Volume 466b89ae-35a1-4834-ab37-c032e84097cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-466b89ae-35a1-4834-ab37-c032e84097cc', 'volume_size': 1, 'image_id': 'fcdfdb20-06bb-4443-a062-13585ee3b408', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fcdfdb20-06bb-4443-a062-13585ee3b408', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c336b67f2aba3eb2d087c60ba774359', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38d0bdfd0be64e79acca5c66116bca08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '29c2b1a9ce631b670fe620c912ef7cbcbc91ce8934a206653d6caaca8ae7ab4df84ef28b71eac4dd9226b8e2719acc443a3f9186511ead6fee4b82e5298b83c7', 'id': 'fcdfdb20-06bb-4443-a062-13585ee3b408', 'created_at': datetime.datetime(2026, 7, 8, 16, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 33, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fcdfdb20-06bb-4443-a062-13585ee3b408/file', 'properties': {}}, 'image_service': } Jul 08 18:33:41 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Trying to clone 466b89ae-35a1-4834-ab37-c032e84097cc from image fcdfdb20-06bb-4443-a062-13585ee3b408 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fcdfdb20-06bb-4443-a062-13585ee3b408', 'metadata': {}}]). {{(pid=87309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:42 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:42 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 18:33:42 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Image download 0.00 MB at 0.00 MB/s Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[43370669-071b-4684-af40-48fcaa4bdd44]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-2159438d-b951-4618-9ad9-a27fc82b41a6-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-2159438d-b951-4618-9ad9-a27fc82b41a6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:42 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" returned: 0 in 0.796s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:42 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD Jul 08 18:33:42 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0ff08e-1150-4e0f-bb5e-0c6c0b82094b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cad5e6-c482-4190-80b8-07f08f24fb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-quobyte-2159438d-b951-4618-9ad9-a27fc82b41a6" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:42 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Volume volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 (025dfb9b-122c-45db-b5ea-63aa1db5c4a6): created successfully Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cad5e6-c482-4190-80b8-07f08f24fb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (3a28774b-1734-44bf-b9f4-e2291e13ab49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-a4c426c4-109d-43d8-9d10-7a54ca31b4cb tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-2159438d-b951-4618-9ad9-a27fc82b41a6" acquired by "delete_volume" :: waited 0.049s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3866bd71-ddb2-44a6-bac2-605823724c87]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:42 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 Jul 08 18:33:42 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:42 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a" returned: 0 in 1.043s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:42 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a Jul 08 18:33:42 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:42 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.809s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Deleted volume successfully. Jul 08 18:33:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6f6cf160-3f40-4a20-b40d-c9b7a95cb46c tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-aad1d695-944f-4643-b5b9-761f1ed53127-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:43 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD" returned: 0 in 0.895s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:43 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD Jul 08 18:33:43 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:43 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6" returned: 0 in 0.897s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:43 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9689e92b-4027-424f-b5b4-b8e633e9932a" returned: 0 in 0.717s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:43 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6 Jul 08 18:33:43 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Lock "cinder-quobyte-9689e92b-4027-424f-b5b4-b8e633e9932a" released by "delete_volume" :: held 1.831s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Created reservations ['87c2002f-e4da-4918-ba78-e0063ce3687a', '270ee24a-8600-4088-9408-9866c50de5ef', 'b6ec2704-5a59-47e4-87e6-7388942a481d', 'a32eddb6-5929-42b9-b786-e8a9a97efd0e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Creating offline snapshot 9beb1f13-d88d-470e-85c6-43b117494fdb of volume 025dfb9b-122c-45db-b5ea-63aa1db5c4a6 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:33:43 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:43 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a17e6a-2efd-4713-997e-6475ba7aa6b2]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:43 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 Jul 08 18:33:43 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:44 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD" returned: 1 in 0.951s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Temporary image fcdfdb20-06bb-4443-a062-13585ee3b408 is fetched for user 99b5e19c4a1c491385382fcefd4a2421. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[db625d91-64ce-47d7-adbc-6cd49e2f50dc]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:44 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-2159438d-b951-4618-9ad9-a27fc82b41a6" returned: 0 in 0.908s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-2159438d-b951-4618-9ad9-a27fc82b41a6" released by "delete_volume" :: held 1.868s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:44 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD Jul 08 18:33:44 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created reservations ['f2562f20-74c8-495d-9744-367e0fe91591', '32d595fc-7840-42f5-896c-0a881f555647', 'e62359b6-850b-489e-a705-ff7db6f17606', 'be095ed0-6e1c-480a-8210-7f87e7da882a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:44 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.792s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Deleted volume successfully. Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5f91b72f-049c-405b-a5cc-2a5d57dc8106 tempest-ProjectReaderTests-660070546 None] Lock "cinder-9689e92b-4027-424f-b5b4-b8e633e9932a-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:44 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:44 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Flow 'volume_create_manager' (bdc3c20c-c49a-4049-906f-55b3f7370c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbff28d-c5af-40c5-a3a4-6d1b3ed5fd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-74e04936-1fc1-4952-9a31-af5880081464-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbff28d-c5af-40c5-a3a4-6d1b3ed5fd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-124450649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40bec4c-a1d8-4721-a7fb-88b055f597e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df88dfbf33df4ab7b4fbdd20650ef992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:45Z,use_quota=True,user_id='b52a59ebd65f4034ad01a393f70e444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f7fc94-b0c8-4fab-b57b-238bd5aedbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f7fc94-b0c8-4fab-b57b-238bd5aedbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd630c0-301e-4dcd-a3a0-69743d4e9b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd630c0-301e-4dcd-a3a0-69743d4e9b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40bec4c-a1d8-4721-a7fb-88b055f597e4', 'volume_name': 'volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97111d3-987a-4ecb-9b2b-3f0a27495175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97111d3-987a-4ecb-9b2b-3f0a27495175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e672f334-4f83-4de8-bfdd-e98d87c0cab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:44 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Volume b40bec4c-a1d8-4721-a7fb-88b055f597e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4', 'volume_size': 1} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-74e04936-1fc1-4952-9a31-af5880081464-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-quobyte-63e9d5fb-8219-40e1-9db4-c21dfac46564" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-63e9d5fb-8219-40e1-9db4-c21dfac46564" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-quobyte-74e04936-1fc1-4952-9a31-af5880081464" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-74e04936-1fc1-4952-9a31-af5880081464" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Deleting offline snapshot 74e04936-1fc1-4952-9a31-af5880081464 of volume 63e9d5fb-8219-40e1-9db4-c21dfac46564 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] snapshot_file for this snap is: volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[adffc85b-b7f2-4d90-8070-2af85f39d680]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:44 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" returned: 0 in 1.100s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:44 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb 1G Jul 08 18:33:44 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:44 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 Jul 08 18:33:44 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:45 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD" returned: 0 in 1.043s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:45 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD Jul 08 18:33:45 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:45 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.800s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Deleted volume successfully. Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-be8e5f5d-6e67-4f80-b131-650b157bde43 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-2159438d-b951-4618-9ad9-a27fc82b41a6-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:45 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464" returned: 0 in 0.788s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63e9d5fb-8219-40e1-9db4-c21dfac46564(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[092e498f-a71c-4f6c-91f6-c1cde279af3c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:45 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb 1G" returned: 0 in 0.870s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:45 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb Jul 08 18:33:45 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:45 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 Jul 08 18:33:45 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:46 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD" returned: 1 in 0.826s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:33:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:46 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564" returned: 0 in 0.760s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:46 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb" returned: 0 in 0.720s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:46 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb is being set with open permissions: ugo+rw Jul 08 18:33:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:46 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 Jul 08 18:33:46 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:46 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb Jul 08 18:33:46 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:47 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb" returned: 0 in 0.668s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:47 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464" returned: 0 in 0.717s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:47 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.info Jul 08 18:33:47 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:47 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464 Jul 08 18:33:47 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:47 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564.74e04936-1fc1-4952-9a31-af5880081464" returned: 0 in 0.635s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:47 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.info" returned: 0 in 0.662s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:47 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.info is being set with open permissions: ugo+rw Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:47 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.info Jul 08 18:33:47 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-74e04936-1fc1-4952-9a31-af5880081464" released by "_delete_snapshot" :: held 3.045s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-63e9d5fb-8219-40e1-9db4-c21dfac46564" released by "delete_snapshot" :: held 3.073s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created reservations ['ba823775-2a3e-4602-b94e-bc04f6bd333d', 'e9ffd9ce-422b-4408-9910-533e148b4c27', 'e53bc24b-ef8f-4045-abe3-dc1c38e6433f', '1211f1ea-acc3-4a68-96fd-da0deab9d2cd'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Delete snapshot completed successfully. Jul 08 18:33:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dc1ecf11-a4a5-44a9-9edf-5a9edf75c222 tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-74e04936-1fc1-4952-9a31-af5880081464-delete_snapshot" released by "delete_snapshot" :: held 3.202s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:48 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.info" returned: 0 in 0.619s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.740s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.678s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-124450649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40bec4c-a1d8-4721-a7fb-88b055f597e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df88dfbf33df4ab7b4fbdd20650ef992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:45Z,use_quota=True,user_id='b52a59ebd65f4034ad01a393f70e444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Creating volume b40bec4c-a1d8-4721-a7fb-88b055f597e4 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:48 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:48 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 1073741824 Jul 08 18:33:48 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:48 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-bf811bcc-29a5-4f13-8965-e0b0dc334738 tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-9beb1f13-d88d-470e-85c6-43b117494fdb-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Lock "cinder-9beb1f13-d88d-470e-85c6-43b117494fdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-9beb1f13-d88d-470e-85c6-43b117494fdb" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-63e9d5fb-8219-40e1-9db4-c21dfac46564-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-9beb1f13-d88d-470e-85c6-43b117494fdb" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:48 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot 9beb1f13-d88d-470e-85c6-43b117494fdb of volume 025dfb9b-122c-45db-b5ea-63aa1db5c4a6 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-63e9d5fb-8219-40e1-9db4-c21dfac46564-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fa99c5-6a0e-4179-a506-e4d5103ee08d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "cinder-quobyte-63e9d5fb-8219-40e1-9db4-c21dfac46564" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-63e9d5fb-8219-40e1-9db4-c21dfac46564" acquired by "delete_volume" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e850c-9201-4a0e-8887-3dc22c5086de]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:49 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb Jul 08 18:33:49 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:49 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 Jul 08 18:33:49 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:49 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 1073741824" returned: 0 in 0.853s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:49 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 Jul 08 18:33:49 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:49 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb" returned: 0 in 0.826s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:33:49 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9685cde6-2fe0-476b-81a8-c6a1c230eab5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564" returned: 0 in 0.800s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:49 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564 Jul 08 18:33:49 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:50 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 Jul 08 18:33:50 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:50 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4" returned: 0 in 0.710s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.996s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466b89ae-35a1-4834-ab37-c032e84097cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d0bdfd0be64e79acca5c66116bca08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:41Z,use_quota=True,user_id='99b5e19c4a1c491385382fcefd4a2421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Creating volume 466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:50 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:50 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc 1073741824 Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e672f334-4f83-4de8-bfdd-e98d87c0cab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:50 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032dc8d2-8ef7-4f5c-aa5a-c7d5785e6e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Volume volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 (b40bec4c-a1d8-4721-a7fb-88b055f597e4): created successfully Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032dc8d2-8ef7-4f5c-aa5a-c7d5785e6e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Flow 'volume_create_manager' (bdc3c20c-c49a-4049-906f-55b3f7370c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c7975fe5-4d45-4d6b-9add-52372ef51cd0 tempest-ProjectReaderTests-660070546 None] Created volume successfully. Jul 08 18:33:50 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-63e9d5fb-8219-40e1-9db4-c21dfac46564" returned: 0 in 0.677s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-quobyte-63e9d5fb-8219-40e1-9db4-c21dfac46564" released by "delete_volume" :: held 1.534s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Created reservations ['574ff158-df91-48bf-8598-4b70b629c63e', '8555ebed-136f-4fdd-b2ce-1a55445129ce', '757819e6-e7b6-4d8e-9eea-2058c69cd2bd', '9ef0c6ac-9314-431d-81bf-24b1e00f5323'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:50 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" returned: 0 in 0.793s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:50 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb Jul 08 18:33:50 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:50 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:50 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:51 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc 1073741824" returned: 0 in 0.954s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Acquiring lock "cinder-b40bec4c-a1d8-4721-a7fb-88b055f597e4-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Lock "cinder-b40bec4c-a1d8-4721-a7fb-88b055f597e4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:51 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc Jul 08 18:33:51 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Acquiring lock "cinder-quobyte-b40bec4c-a1d8-4721-a7fb-88b055f597e4" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Lock "cinder-quobyte-b40bec4c-a1d8-4721-a7fb-88b055f597e4" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[417a487c-0f36-4c00-8e19-be2b2f333bfa]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:51 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 Jul 08 18:33:51 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:51 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.918s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:51 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Deleted volume successfully. Jul 08 18:33:51 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb" returned: 0 in 1.034s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-bae1678c-3750-45d3-9876-a0c2d90f90ba tempest-CreateVolumesFromSnapshotTest-1216673211 None] Lock "cinder-63e9d5fb-8219-40e1-9db4-c21dfac46564-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:51 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb Jul 08 18:33:51 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:52 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc" returned: 0 in 0.941s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Attempting download of fcdfdb20-06bb-4443-a062-13585ee3b408 ((None, [{'url': 'file:///opt/stack/data/glance/images/fcdfdb20-06bb-4443-a062-13585ee3b408', 'metadata': {}}])) to volume 466b89ae-35a1-4834-ab37-c032e84097cc. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd2174e-a9d5-4712-b31c-93a9528d86da]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fcdfdb20-06bb-4443-a062-13585ee3b408_a7waq9xs {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:52 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4" returned: 0 in 1.059s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:52 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4 Jul 08 18:33:52 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:52 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fcdfdb20-06bb-4443-a062-13585ee3b408_a7waq9xs Jul 08 18:33:52 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:52 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6.9beb1f13-d88d-470e-85c6-43b117494fdb" returned: 0 in 0.834s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-9beb1f13-d88d-470e-85c6-43b117494fdb" released by "_delete_snapshot" :: held 3.647s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" released by "delete_snapshot" :: held 3.688s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Created reservations ['31946a67-573a-4d2d-a164-1e5048d504fe', '214d1a8a-0843-4c15-b09a-3b8ddaa6fd41', '34cdd645-beb1-4ff3-8bcf-6c4759335c17', '029f176e-b15b-4770-9fe4-a5d736b174d3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:33:52 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d5947113-2060-4a6d-8813-1dd016f8cd37 tempest-ProjectMemberTests-934051372 None] Lock "cinder-9beb1f13-d88d-470e-85c6-43b117494fdb-delete_snapshot" released by "delete_snapshot" :: held 3.903s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:53 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-b40bec4c-a1d8-4721-a7fb-88b055f597e4" returned: 0 in 0.749s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Lock "cinder-quobyte-b40bec4c-a1d8-4721-a7fb-88b055f597e4" released by "delete_volume" :: held 1.872s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:53 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fcdfdb20-06bb-4443-a062-13585ee3b408_a7waq9xs" returned: 0 in 0.872s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fcdfdb20-06bb-4443-a062-13585ee3b408_a7waq9xs {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Created reservations ['c2c91f32-ccfe-44c5-b03c-ed41133d5544', '52110d19-bd61-4333-9a95-c08a8f815fbf', '913d11b5-ab16-4a47-a58a-078a8926ce1b', '33aad7f1-514e-4289-b630-29449369a8ab'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:53 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fcdfdb20-06bb-4443-a062-13585ee3b408_a7waq9xs Jul 08 18:33:53 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:53 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:53 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-025dfb9b-122c-45db-b5ea-63aa1db5c4a6-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Lock "cinder-025dfb9b-122c-45db-b5ea-63aa1db5c4a6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" acquired by "delete_volume" :: waited 0.037s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e21b74d-831f-4147-842b-5f861492f3cf]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:53 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 Jul 08 18:33:53 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:53 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Flow 'volume_create_manager' (797eb1d4-5933-407a-b433-8f27c7902213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7bd3f4-dc1b-410f-a324-f9c2ed265431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7bd3f4-dc1b-410f-a324-f9c2ed265431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700907028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec0195c-95c6-499d-84ff-4f1202f78ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df88dfbf33df4ab7b4fbdd20650ef992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:54Z,use_quota=True,user_id='b52a59ebd65f4034ad01a393f70e444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c74fba4-9fcf-49ea-a96b-77dec8e90bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c74fba4-9fcf-49ea-a96b-77dec8e90bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192d0acc-2806-43a6-bbab-46bb5e1be99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192d0acc-2806-43a6-bbab-46bb5e1be99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec0195c-95c6-499d-84ff-4f1202f78ff2', 'volume_name': 'volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a8fb6f-4534-42c5-ac3d-51fdc8143c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a8fb6f-4534-42c5-ac3d-51fdc8143c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38af2cd5-c22d-48cd-8152-c348b5a16544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:54 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Volume 9ec0195c-95c6-499d-84ff-4f1202f78ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2', 'volume_size': 1} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700907028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec0195c-95c6-499d-84ff-4f1202f78ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df88dfbf33df4ab7b4fbdd20650ef992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:54Z,use_quota=True,user_id='b52a59ebd65f4034ad01a393f70e444d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:54 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Creating volume 9ec0195c-95c6-499d-84ff-4f1202f78ff2 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:54 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fcdfdb20-06bb-4443-a062-13585ee3b408_a7waq9xs" returned: 1 in 1.062s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fcdfdb20-06bb-4443-a062-13585ee3b408_a7waq9xs' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a455fe-802b-4f16-b889-555b4cc384a7]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:54 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 1073741824 Jul 08 18:33:54 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:54 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 1.046s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:54 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Deleted volume successfully. Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-550697a5-50c1-43de-83f6-ad9d3d1c53eb tempest-ProjectReaderTests-660070546 None] Lock "cinder-b40bec4c-a1d8-4721-a7fb-88b055f597e4-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:54 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD Jul 08 18:33:54 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:54 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" returned: 0 in 1.316s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:54 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6 Jul 08 18:33:54 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:55 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 1073741824" returned: 0 in 1.032s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:55 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD" returned: 0 in 1.026s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Flow 'volume_create_manager' (ac6ddc0b-6e9a-46b8-8144-010b77408a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ade427-e5fa-4588-b401-0bf8fc00847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:55 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD Jul 08 18:33:55 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:55 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 Jul 08 18:33:55 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ade427-e5fa-4588-b401-0bf8fc00847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-892221427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9908ba6c-4739-479f-a669-34f53c797c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5cadb34aa143329274ff6db29cfc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:55Z,use_quota=True,user_id='6fb6c788dc7b4934b1de06e7c396ad26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54798201-77ab-46a9-8207-329907cece9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54798201-77ab-46a9-8207-329907cece9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b86d7-8a7d-44b3-9f20-c7880dbdd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028b86d7-8a7d-44b3-9f20-c7880dbdd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9908ba6c-4739-479f-a669-34f53c797c8b', 'volume_name': 'volume-9908ba6c-4739-479f-a669-34f53c797c8b', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a29f81-ba82-4c47-8ff3-e7f28fd0171a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a29f81-ba82-4c47-8ff3-e7f28fd0171a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576340ad-dae1-40b3-96d1-f726a40ced97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:55 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Volume 9908ba6c-4739-479f-a669-34f53c797c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9908ba6c-4739-479f-a669-34f53c797c8b', 'volume_size': 1} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:55 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" returned: 0 in 0.758s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-025dfb9b-122c-45db-b5ea-63aa1db5c4a6" released by "delete_volume" :: held 2.170s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Created reservations ['76e403d1-599a-4926-9e2d-142382fc64d9', 'ac2c99ae-e756-4bb4-8fdc-8b6177af8774', 'cfcea415-b328-4fee-949d-80b8d813d021', '0a9c07de-96df-4f48-aeda-43f6f4facefd'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:55 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:55 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:55 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD" returned: 1 in 0.842s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] fcdfdb20-06bb-4443-a062-13585ee3b408 was raw, converting to raw {{(pid=87309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 18:33:55 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2" returned: 0 in 0.775s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-892221427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9908ba6c-4739-479f-a669-34f53c797c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5cadb34aa143329274ff6db29cfc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:55Z,use_quota=True,user_id='6fb6c788dc7b4934b1de06e7c396ad26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Creating volume 9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:56 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc Jul 08 18:33:56 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:56 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38af2cd5-c22d-48cd-8152-c348b5a16544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:56 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b 1073741824 Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54959266-cf62-46a1-86e0-505dd3559a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:56 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:56 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Volume volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 (9ec0195c-95c6-499d-84ff-4f1202f78ff2): created successfully Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54959266-cf62-46a1-86e0-505dd3559a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Flow 'volume_create_manager' (797eb1d4-5933-407a-b433-8f27c7902213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-46005e6a-530e-4692-b095-91cb1cf6449a tempest-ProjectReaderTests-660070546 None] Created volume successfully. Jul 08 18:33:56 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.732s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-0f59a60a-28c7-4cec-acb2-6e3072db3a34 tempest-ProjectMemberTests-934051372 None] Lock "cinder-025dfb9b-122c-45db-b5ea-63aa1db5c4a6-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:56 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc" returned: 0 in 0.769s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fcdfdb20-06bb-4443-a062-13585ee3b408_7eea5edidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:33:56 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:56 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc 1G Jul 08 18:33:56 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:56 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b 1073741824" returned: 0 in 0.880s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:56 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b Jul 08 18:33:56 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Acquiring lock "cinder-9ec0195c-95c6-499d-84ff-4f1202f78ff2-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Lock "cinder-9ec0195c-95c6-499d-84ff-4f1202f78ff2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Acquiring lock "cinder-quobyte-9ec0195c-95c6-499d-84ff-4f1202f78ff2" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Lock "cinder-quobyte-9ec0195c-95c6-499d-84ff-4f1202f78ff2" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (ea330ec1-5f7c-476c-8574-42a38d9c8435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb2d000-c694-4ff1-aa94-b528776f1f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c43c2-2a68-4fb9-8103-854678d7ca2a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb2d000-c694-4ff1-aa94-b528776f1f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899653142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:57Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e98fc9b-5943-4c94-978b-b73aae8da9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e98fc9b-5943-4c94-978b-b73aae8da9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b127a02d-5329-4672-8f29-37c88446de71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b127a02d-5329-4672-8f29-37c88446de71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17', 'volume_name': 'volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868832db-828f-4aca-88ff-83d3fa683824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868832db-828f-4aca-88ff-83d3fa683824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e8b4a8-c576-4d80-bad6-23974be2181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:57 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Volume e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17', 'volume_size': 1} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:57 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 Jul 08 18:33:57 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:57 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc 1G" returned: 0 in 0.869s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3078bd51-cac3-4446-8df4-723a7749212c]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:57 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b" returned: 0 in 0.811s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899653142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:33:57Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Creating volume e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:33:57 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:57 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 1073741824 Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576340ad-dae1-40b3-96d1-f726a40ced97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9908ba6c-4739-479f-a669-34f53c797c8b', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:57 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187452bf-e1ec-4d03-a051-0a59dfaa1f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:57 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc Jul 08 18:33:57 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:57 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Volume volume-9908ba6c-4739-479f-a669-34f53c797c8b (9908ba6c-4739-479f-a669-34f53c797c8b): created successfully Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187452bf-e1ec-4d03-a051-0a59dfaa1f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:57 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Flow 'volume_create_manager' (ac6ddc0b-6e9a-46b8-8144-010b77408a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:57 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1f0a83c0-b45b-4962-8481-0c0744f45d90 tempest-VolumeDependencyTests-1170219967 None] Created volume successfully. Jul 08 18:33:58 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2" returned: 0 in 0.839s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:58 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2 Jul 08 18:33:58 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:58 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc" returned: 0 in 0.937s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:58 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc Jul 08 18:33:58 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:58 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 1073741824" returned: 0 in 0.980s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:58 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 Jul 08 18:33:58 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:59 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9ec0195c-95c6-499d-84ff-4f1202f78ff2" returned: 0 in 0.818s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Lock "cinder-quobyte-9ec0195c-95c6-499d-84ff-4f1202f78ff2" released by "delete_volume" :: held 1.735s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Created reservations ['57927b4c-7926-477d-828b-0ce926b5a9a0', '0efd6cc2-05b7-4b76-927e-eac87f7877a2', 'ca09e5b1-04fa-44fa-a6e3-f4bbd69b8442', '97c265be-189c-4a07-9b0f-711fdd07e26f'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:59 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:33:59 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:59 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc" returned: 1 in 0.762s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Downloaded image fcdfdb20-06bb-4443-a062-13585ee3b408 ((None, [{'url': 'file:///opt/stack/data/glance/images/fcdfdb20-06bb-4443-a062-13585ee3b408', 'metadata': {}}])) to volume 466b89ae-35a1-4834-ab37-c032e84097cc successfully. {{(pid=87309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Temporary image fcdfdb20-06bb-4443-a062-13585ee3b408 for user 99b5e19c4a1c491385382fcefd4a2421 is deleted. {{(pid=87309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.volume_utils [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Marking volume 466b89ae-35a1-4834-ab37-c032e84097cc as bootable. {{(pid=87309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Copying metadata from image fcdfdb20-06bb-4443-a062-13585ee3b408 to 466b89ae-35a1-4834-ab37-c032e84097cc. {{(pid=87309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Creating volume glance metadata for volume 466b89ae-35a1-4834-ab37-c032e84097cc backed by image fcdfdb20-06bb-4443-a062-13585ee3b408 with: {'image_id': 'fcdfdb20-06bb-4443-a062-13585ee3b408', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7c336b67f2aba3eb2d087c60ba774359', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92e217d-89ce-4563-bc33-b1b679761d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466b89ae-35a1-4834-ab37-c032e84097cc', 'volume_size': 1, 'image_id': 'fcdfdb20-06bb-4443-a062-13585ee3b408', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fcdfdb20-06bb-4443-a062-13585ee3b408', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c336b67f2aba3eb2d087c60ba774359', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38d0bdfd0be64e79acca5c66116bca08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '29c2b1a9ce631b670fe620c912ef7cbcbc91ce8934a206653d6caaca8ae7ab4df84ef28b71eac4dd9226b8e2719acc443a3f9186511ead6fee4b82e5298b83c7', 'id': 'fcdfdb20-06bb-4443-a062-13585ee3b408', 'created_at': datetime.datetime(2026, 7, 8, 16, 33, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 16, 33, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fcdfdb20-06bb-4443-a062-13585ee3b408/file', 'properties': {}}, 'image_service': }' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdbecf4-b73e-49b2-83b4-4728b310f2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:59 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Volume volume-466b89ae-35a1-4834-ab37-c032e84097cc (466b89ae-35a1-4834-ab37-c032e84097cc): created successfully Jul 08 18:33:59 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdbecf4-b73e-49b2-83b4-4728b310f2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Flow 'volume_create_manager' (65e4641d-d2f1-42f4-a43c-d184b0e1ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" returned: 0 in 0.718s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.912s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:33:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ae56f408-f500-4bb3-8b0f-a2dbde9cbb6d tempest-VolumeImageDependencyTests-2047959952 None] Created volume successfully. Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e8b4a8-c576-4d80-bad6-23974be2181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e1c277-4da0-46ea-9279-11b6add4b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Creating offline snapshot 6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e of volume 9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:33:59 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Volume volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 (e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17): created successfully Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e1c277-4da0-46ea-9279-11b6add4b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (ea330ec1-5f7c-476c-8574-42a38d9c8435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60a74d5-ddbf-4e12-9161-6757df1cb598]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:33:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1aee7d2c-4c62-4f90-a2b4-7b2de88f0e04 tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:33:59 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b Jul 08 18:33:59 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Acquiring lock "cinder-466b89ae-35a1-4834-ab37-c032e84097cc-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Lock "cinder-466b89ae-35a1-4834-ab37-c032e84097cc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Acquiring lock "cinder-quobyte-466b89ae-35a1-4834-ab37-c032e84097cc" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:33:59 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.759s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:33:59 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:33:59 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Deleted volume successfully. Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Lock "cinder-quobyte-466b89ae-35a1-4834-ab37-c032e84097cc" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-785ddf78-343c-41a5-b332-8b17988ab3de tempest-ProjectReaderTests-660070546 None] Lock "cinder-9ec0195c-95c6-499d-84ff-4f1202f78ff2-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[59049a04-a2ef-45ab-a604-de4ed138c9c3]: (4, 'raw') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:00 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc Jul 08 18:34:00 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:00 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b" returned: 0 in 0.997s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:00 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e 1G Jul 08 18:34:00 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:00 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc" returned: 0 in 0.864s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:01 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc Jul 08 18:34:01 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:01 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e 1G" returned: 0 in 0.983s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9908ba6c-4739-479f-a669-34f53c797c8b -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:01 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9908ba6c-4739-479f-a669-34f53c797c8b -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e Jul 08 18:34:01 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:01 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc" returned: 1 in 0.801s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc' failed. Not Retrying. {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 18:34:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:01 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc Jul 08 18:34:01 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:02 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:02 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-466b89ae-35a1-4834-ab37-c032e84097cc" returned: 0 in 0.658s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9908ba6c-4739-479f-a669-34f53c797c8b -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" returned: 0 in 0.819s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:02 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e is being set with open permissions: ugo+rw Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Lock "cinder-quobyte-466b89ae-35a1-4834-ab37-c032e84097cc" released by "delete_volume" :: held 2.412s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:02 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e Jul 08 18:34:02 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Created reservations ['bc6a9667-a5e2-4245-814b-4d99ebcab872', 'ab61a20d-0ef2-4965-aabd-9b9d696ab6b5', '6b79b4b0-5c59-4d6c-9682-e97c9172013a', 'c70cfdcc-2701-4553-a1d8-5de280fd3d4e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:02 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:34:02 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:03 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" returned: 0 in 0.640s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:03 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.info Jul 08 18:34:03 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:03 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.642s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:03 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Deleted volume successfully. Jul 08 18:34:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-423d3bc8-47bc-4784-ba9b-a5f509aaabb9 tempest-VolumeImageDependencyTests-2047959952 None] Lock "cinder-466b89ae-35a1-4834-ab37-c032e84097cc-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:03 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.info" returned: 0 in 0.742s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:03 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.info is being set with open permissions: ugo+rw Jul 08 18:34:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:03 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.info Jul 08 18:34:03 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:04 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.info" returned: 0 in 0.675s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.640s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:04 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Creating offline snapshot 53df4ee7-6040-40c1-bddb-f0add0728434 of volume e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:34:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-00eac8ed-99db-4871-9eb7-e9b3d3dbb85a tempest-VolumeDependencyTests-1170219967 None] Create snapshot completed successfully Jul 08 18:34:04 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0296fce-6112-4747-9167-6c0998b6ea8c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:04 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 Jul 08 18:34:04 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Flow 'volume_create_manager' (78b12ba5-f42f-4207-8e2b-370144d0f4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33897a29-2a7a-42d7-bbc5-b309e72d3594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:05 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33897a29-2a7a-42d7-bbc5-b309e72d3594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1515389782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653b358b-ce23-45cf-8804-d9132eb04025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5cadb34aa143329274ff6db29cfc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:05Z,use_quota=True,user_id='6fb6c788dc7b4934b1de06e7c396ad26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39de1c1-8329-4e60-a225-dffb492e1e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39de1c1-8329-4e60-a225-dffb492e1e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6647a3c7-e15a-4e3b-9cca-271ef5bdb7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6647a3c7-e15a-4e3b-9cca-271ef5bdb7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '653b358b-ce23-45cf-8804-d9132eb04025', 'volume_name': 'volume-653b358b-ce23-45cf-8804-d9132eb04025', 'volume_size': 1, 'snapshot_id': '6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6043b5-8be5-4f0c-af1a-551dd86ba1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6043b5-8be5-4f0c-af1a-551dd86ba1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30431c0-edb6-47c8-8f36-08beb52b9491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:05 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Volume 653b358b-ce23-45cf-8804-d9132eb04025: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-653b358b-ce23-45cf-8804-d9132eb04025', 'volume_size': 1, 'snapshot_id': '6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e'} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" returned: 0 in 1.009s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:05 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 1G Jul 08 18:34:05 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:06 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 1G" returned: 0 in 0.905s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:06 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 Jul 08 18:34:06 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:07 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434" returned: 0 in 0.705s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:07 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 is being set with open permissions: ugo+rw Jul 08 18:34:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:07 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 Jul 08 18:34:07 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:07 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434" returned: 0 in 0.662s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:07 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.info Jul 08 18:34:07 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:08 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.info" returned: 0 in 0.674s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:08 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.info is being set with open permissions: ugo+rw Jul 08 18:34:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:08 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.info Jul 08 18:34:08 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:09 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.info" returned: 0 in 0.660s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.706s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.638s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-quobyte-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e-653b358b-ce23-45cf-8804-d9132eb04025" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e-653b358b-ce23-45cf-8804-d9132eb04025" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Creating volume 653b358b-ce23-45cf-8804-d9132eb04025 from snapshot 6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-quobyte-653b358b-ce23-45cf-8804-d9132eb04025" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7243c183-c292-4dfd-a1b7-1dfc4d32f2f7 tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-653b358b-ce23-45cf-8804-d9132eb04025" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] snapshot: 6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e, volume: 653b358b-ce23-45cf-8804-d9132eb04025, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c12a8fa-341f-4691-9225-3d98928f22f9]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:09 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e Jul 08 18:34:09 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:10 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" returned: 0 in 0.777s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9908ba6c-4739-479f-a669-34f53c797c8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44d71b4-6455-4244-8e39-e11d6cc08e31]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-53df4ee7-6040-40c1-bddb-f0add0728434-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:10 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b Jul 08 18:34:10 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Lock "cinder-53df4ee7-6040-40c1-bddb-f0add0728434-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-53df4ee7-6040-40c1-bddb-f0add0728434" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-53df4ee7-6040-40c1-bddb-f0add0728434" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot 53df4ee7-6040-40c1-bddb-f0add0728434 of volume e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8639c427-536d-4c7a-bcf3-4e2b4b271c82]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:10 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 Jul 08 18:34:10 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:10 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b" returned: 0 in 0.744s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:34:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:10 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 Jul 08 18:34:10 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:11 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434" returned: 0 in 0.735s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:34:11 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7b4d6b-687f-404f-8169-63b98aec2479]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:11 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 Jul 08 18:34:11 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:12 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" returned: 0 in 1.013s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:12 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 Jul 08 18:34:12 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:14 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434" returned: 0 in 1.969s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:14 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434 Jul 08 18:34:14 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17.53df4ee7-6040-40c1-bddb-f0add0728434" returned: 0 in 1.425s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:15 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-53df4ee7-6040-40c1-bddb-f0add0728434" released by "_delete_snapshot" :: held 5.239s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" released by "delete_snapshot" :: held 5.264s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:15 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Created reservations ['ffaa65d6-20a6-448e-bbec-4bb2fde65727', 'a7bf8e10-4ae3-4993-bc2e-f0db6b5b4676', '0c103617-c808-4373-aa9d-9424f460dc23', '102504f6-edc5-4af6-ab3e-d8345cdf3ad3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:15 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025" returned: 0 in 4.742s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:15 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3199c-1e1e-49cf-bbaf-82a62ab9a910]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:15 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:34:15 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-563349e7-9f39-4b6c-8a5c-0d88ab576afe tempest-ProjectMemberTests-934051372 None] Lock "cinder-53df4ee7-6040-40c1-bddb-f0add0728434-delete_snapshot" released by "delete_snapshot" :: held 5.420s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:15 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b Jul 08 18:34:15 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:16 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b" returned: 0 in 0.884s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:34:16 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Converted 1024.00 MB image at 215.92 MB/s Jul 08 18:34:16 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 is being set with open permissions: ugo+rw Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:16 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 Jul 08 18:34:16 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Lock "cinder-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" acquired by "delete_volume" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fcf92a-2ac6-488e-9ecc-2382fd0cbdee]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:16 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 Jul 08 18:34:16 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:17 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025" returned: 0 in 0.609s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-653b358b-ce23-45cf-8804-d9132eb04025" released by "_copy_volume_from_snapshot" :: held 7.858s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e-653b358b-ce23-45cf-8804-d9132eb04025" released by "_create_volume_from_snapshot" :: held 7.898s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.930s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30431c0-edb6-47c8-8f36-08beb52b9491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653b358b-ce23-45cf-8804-d9132eb04025', 'volume_size': 1, 'snapshot_id': '6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf888bf-a3ad-4c81-9fea-63492144b7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:17 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Volume volume-653b358b-ce23-45cf-8804-d9132eb04025 (653b358b-ce23-45cf-8804-d9132eb04025): created successfully Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf888bf-a3ad-4c81-9fea-63492144b7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Flow 'volume_create_manager' (78b12ba5-f42f-4207-8e2b-370144d0f4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:17 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2ebc7a1f-472d-4ea0-b44e-64b18cf442d1 tempest-VolumeDependencyTests-1170219967 None] Created volume successfully. Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-quobyte-9908ba6c-4739-479f-a669-34f53c797c8b" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-9908ba6c-4739-479f-a669-34f53c797c8b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-quobyte-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Deleting offline snapshot 6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e of volume 9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] snapshot_file for this snap is: volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d50bb9-70c1-4a83-8917-a0b1a5c0651b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:17 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" returned: 0 in 0.782s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:17 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17 Jul 08 18:34:17 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:17 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e Jul 08 18:34:17 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:18 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" returned: 0 in 0.627s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17" released by "delete_volume" :: held 1.468s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:18 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" returned: 0 in 0.737s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9908ba6c-4739-479f-a669-34f53c797c8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c912a285-9d61-4307-b6c1-e0a9a87551c9]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Created reservations ['5a668e74-ec36-4ab9-95a7-92215fb8f8d7', 'f5e16a79-2467-483c-b42f-a892653f1c97', '620110b9-86c2-457e-b09d-5127d25af4a8', 'd34c0c1d-7be6-4d7a-ade3-9ece49a8b888'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:18 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:34:18 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b Jul 08 18:34:18 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:18 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:19 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.647s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:19 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-042b2486-1c1d-4c8b-871c-26d5854602d1 tempest-ProjectMemberTests-934051372 None] Lock "cinder-e3e6066c-5ee9-4ad2-b66b-c73ade8b3f17-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:19 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b" returned: 0 in 0.795s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:19 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e Jul 08 18:34:19 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (937c4974-5956-4cfe-a285-0da478248f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca816aa-b5e9-4ac3-8442-d9a7871f060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca816aa-b5e9-4ac3-8442-d9a7871f060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840659380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e490d6-629d-4c3d-a3c5-b94d9e754d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:19Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e75832e-9228-41bf-a7ed-599f5795681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e75832e-9228-41bf-a7ed-599f5795681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ec8f35-f726-418b-ad97-7f1c4aee2506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ec8f35-f726-418b-ad97-7f1c4aee2506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e490d6-629d-4c3d-a3c5-b94d9e754d68', 'volume_name': 'volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fea416b-bbeb-416b-a35b-f8713e81347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fea416b-bbeb-416b-a35b-f8713e81347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06795a0e-cba7-49be-a66a-b779e92bd255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:19 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Volume 66e490d6-629d-4c3d-a3c5-b94d9e754d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68', 'volume_size': 1} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840659380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e490d6-629d-4c3d-a3c5-b94d9e754d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:19Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Creating volume 66e490d6-629d-4c3d-a3c5-b94d9e754d68 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:19 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:19 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 1073741824 Jul 08 18:34:19 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:19 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" returned: 0 in 0.745s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:19 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e Jul 08 18:34:19 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:20 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 1073741824" returned: 0 in 0.814s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:20 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 Jul 08 18:34:20 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:20 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b.6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" returned: 0 in 0.626s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e" released by "_delete_snapshot" :: held 3.004s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-9908ba6c-4739-479f-a669-34f53c797c8b" released by "delete_snapshot" :: held 3.026s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Created reservations ['a0c7409d-da04-441d-b6f5-91e65687eedb', '842447ec-f1cd-47d1-ad7a-16b01a726f0c', 'f72b6731-03c6-4246-a1f0-b66e83b1dc19', '29f81f8b-6257-4ab7-9a65-6b4ca18f8c68'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:20 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Delete snapshot completed successfully. Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d2ce9a44-882a-4871-86c2-0aa280cb2fa3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-6d0e49c8-3e7f-40af-b1ec-9dbfeb79162e-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:20 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68" returned: 0 in 0.624s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06795a0e-cba7-49be-a66a-b779e92bd255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a9490c-375f-4277-8a92-db68aaba9461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:21 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Volume volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 (66e490d6-629d-4c3d-a3c5-b94d9e754d68): created successfully Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a9490c-375f-4277-8a92-db68aaba9461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (937c4974-5956-4cfe-a285-0da478248f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:21 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-24beb4ca-bf46-4d34-9ff9-a2c98c07bd5a tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Creating offline snapshot 630fdcf8-36bf-418f-89e9-b6e835b90172 of volume 66e490d6-629d-4c3d-a3c5-b94d9e754d68 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddac536-d91b-4ec3-ba6e-8bfca4de8d51]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-9908ba6c-4739-479f-a669-34f53c797c8b-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-9908ba6c-4739-479f-a669-34f53c797c8b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-quobyte-9908ba6c-4739-479f-a669-34f53c797c8b" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:21 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 Jul 08 18:34:21 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-9908ba6c-4739-479f-a669-34f53c797c8b" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2d24aa-1a62-4e4d-b1af-1f43943a6507]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:21 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b Jul 08 18:34:21 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:22 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68" returned: 0 in 0.745s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:22 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 1G Jul 08 18:34:22 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:22 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b" returned: 0 in 0.726s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:22 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b Jul 08 18:34:22 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:23 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 1G" returned: 0 in 0.768s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:23 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9908ba6c-4739-479f-a669-34f53c797c8b" returned: 0 in 0.640s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:23 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 Jul 08 18:34:23 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-9908ba6c-4739-479f-a669-34f53c797c8b" released by "delete_volume" :: held 1.421s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=159,cinder:UPDATE=234,cinder:INSERT=54,cinder:DELETE=17 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=212,cinder:SELECT=169,cinder:INSERT=67,cinder:DELETE=19 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Created reservations ['9e8868b8-f225-4acb-a5a1-8e3f390e3e61', '6221ae66-11fc-4f6e-a56c-5e41e9c230d2', '2a3fa75a-f408-401d-8326-2d2175215872', 'd042cb72-08c9-4c74-a352-564c877f2e19'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:23 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:34:23 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:23 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172" returned: 0 in 0.678s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:23 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 is being set with open permissions: ugo+rw Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:23 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 Jul 08 18:34:23 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-653b358b-ce23-45cf-8804-d9132eb04025-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-653b358b-ce23-45cf-8804-d9132eb04025-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:23 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.656s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Deleted volume successfully. Jul 08 18:34:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "cinder-quobyte-653b358b-ce23-45cf-8804-d9132eb04025" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-81e80c08-af1f-4ac3-8bd2-9d428bbd0bc3 tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-9908ba6c-4739-479f-a669-34f53c797c8b-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-653b358b-ce23-45cf-8804-d9132eb04025" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:24 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2008f0-78b0-47ce-b012-3556f0ad9959]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:24 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 Jul 08 18:34:24 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:24 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172" returned: 0 in 0.688s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:24 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.info Jul 08 18:34:24 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:24 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025" returned: 0 in 0.747s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:24 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025 Jul 08 18:34:24 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:25 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.info" returned: 0 in 0.627s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:25 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.info is being set with open permissions: ugo+rw Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:25 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.info Jul 08 18:34:25 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:25 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-653b358b-ce23-45cf-8804-d9132eb04025" returned: 0 in 0.643s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-quobyte-653b358b-ce23-45cf-8804-d9132eb04025" released by "delete_volume" :: held 1.433s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Created reservations ['b952b1fb-4c35-4b85-844f-bbe29634a4cf', '280d81cb-350f-4068-bb11-c99041577782', '73fca48e-664e-46e9-bc1b-238379b8d685', '8e058779-7eed-457f-b916-bc3120d6dd19'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:25 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:34:25 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:25 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.info" returned: 0 in 0.641s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.220s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:25 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2a1be1c5-3152-4c19-8f9f-1243f9cac7ed tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:34:26 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.672s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:26 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Deleted volume successfully. Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-26da0d83-d21c-4fe3-938f-804e1c91432f tempest-VolumeDependencyTests-1170219967 None] Lock "cinder-653b358b-ce23-45cf-8804-d9132eb04025-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-630fdcf8-36bf-418f-89e9-b6e835b90172-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Lock "cinder-630fdcf8-36bf-418f-89e9-b6e835b90172-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-66e490d6-629d-4c3d-a3c5-b94d9e754d68" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-66e490d6-629d-4c3d-a3c5-b94d9e754d68" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-630fdcf8-36bf-418f-89e9-b6e835b90172" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-630fdcf8-36bf-418f-89e9-b6e835b90172" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot 630fdcf8-36bf-418f-89e9-b6e835b90172 of volume 66e490d6-629d-4c3d-a3c5-b94d9e754d68 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdc44c9-35df-4ff4-85da-46b6112a5dfe]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:27 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 Jul 08 18:34:27 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:27 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172" returned: 0 in 0.801s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:34:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5682de9d-7460-4957-9386-ec7282db9a29]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:27 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 Jul 08 18:34:27 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:28 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68" returned: 0 in 0.768s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:28 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 Jul 08 18:34:28 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:29 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172" returned: 0 in 0.716s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:29 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172 Jul 08 18:34:29 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (268d4abc-6a23-4bd5-9c56-38df02ad93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67e6fca-f7ac-49cb-8f77-0563d61ff9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67e6fca-f7ac-49cb-8f77-0563d61ff9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007264686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153425ce-d5e5-404d-a5e2-1e089c707d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:30Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218168bd-2b3d-4a85-9b12-152ce462497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218168bd-2b3d-4a85-9b12-152ce462497f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b159f98c-59ab-4bed-8369-3081fccb1c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b159f98c-59ab-4bed-8369-3081fccb1c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153425ce-d5e5-404d-a5e2-1e089c707d48', 'volume_name': 'volume-153425ce-d5e5-404d-a5e2-1e089c707d48', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a13810-eda9-4768-a903-0f7b9237ad87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a13810-eda9-4768-a903-0f7b9237ad87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4c2c2f-626f-4f95-8d2a-771bc613cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:29 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Volume 153425ce-d5e5-404d-a5e2-1e089c707d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153425ce-d5e5-404d-a5e2-1e089c707d48', 'volume_size': 1} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007264686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153425ce-d5e5-404d-a5e2-1e089c707d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:30Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Creating volume 153425ce-d5e5-404d-a5e2-1e089c707d48 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:29 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:29 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 1073741824 Jul 08 18:34:29 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:29 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68.630fdcf8-36bf-418f-89e9-b6e835b90172" returned: 0 in 0.640s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-630fdcf8-36bf-418f-89e9-b6e835b90172" released by "_delete_snapshot" :: held 3.044s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:29 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-66e490d6-629d-4c3d-a3c5-b94d9e754d68" released by "delete_snapshot" :: held 3.072s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:30 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Created reservations ['c23ff04a-184e-42d6-8214-572657446456', '8a158ce7-8f19-4bd6-bc8c-3f21db561cfa', '2e14b673-b2e9-480d-8ac9-e9292ae927d7', 'f037d5fe-f6a1-4682-a8c5-3553dc304019'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:30 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:34:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6fbe741e-ceb6-4168-9eb1-846e0ccdf75b tempest-ProjectMemberTests-934051372 None] Lock "cinder-630fdcf8-36bf-418f-89e9-b6e835b90172-delete_snapshot" released by "delete_snapshot" :: held 3.222s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:30 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 1073741824" returned: 0 in 0.850s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:30 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 Jul 08 18:34:30 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-66e490d6-629d-4c3d-a3c5-b94d9e754d68-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Lock "cinder-66e490d6-629d-4c3d-a3c5-b94d9e754d68-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-66e490d6-629d-4c3d-a3c5-b94d9e754d68" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-66e490d6-629d-4c3d-a3c5-b94d9e754d68" acquired by "delete_volume" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d6b119-7f46-40cb-8367-d69b9684d4eb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:31 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48" returned: 0 in 0.626s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:31 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 Jul 08 18:34:31 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4c2c2f-626f-4f95-8d2a-771bc613cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153425ce-d5e5-404d-a5e2-1e089c707d48', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848d92e8-3a27-40d8-ac16-f098a1aea323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:31 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Volume volume-153425ce-d5e5-404d-a5e2-1e089c707d48 (153425ce-d5e5-404d-a5e2-1e089c707d48): created successfully Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848d92e8-3a27-40d8-ac16-f098a1aea323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (268d4abc-6a23-4bd5-9c56-38df02ad93af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-465bbb7f-51cc-41cf-ab27-5b69e2d040ff tempest-ProjectReaderTests-101602282 None] Created volume successfully. Jul 08 18:34:31 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68" returned: 0 in 0.743s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:31 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68 Jul 08 18:34:31 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Creating offline snapshot fc813d40-c6a7-4832-8799-652d9b42e6fa of volume 153425ce-d5e5-404d-a5e2-1e089c707d48 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa9ff33-1392-48fa-bebb-fb28082c8e6b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:32 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 Jul 08 18:34:32 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:32 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-66e490d6-629d-4c3d-a3c5-b94d9e754d68" returned: 0 in 0.623s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-66e490d6-629d-4c3d-a3c5-b94d9e754d68" released by "delete_volume" :: held 1.426s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Created reservations ['ae77f709-e340-4a21-93b5-e9d3cf28fa73', 'cca6b232-94aa-4a7d-ac1a-30aba08c1d68', '10eb4153-403c-4fa9-9e15-39a0c0af0625', 'a0a0390b-589c-47f8-a1c9-9e639fbe4318'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:32 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:34:32 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:32 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48" returned: 0 in 0.785s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:32 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa 1G Jul 08 18:34:32 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:33 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.663s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:33 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-77625902-a8bc-423a-a56b-147e1d90975a tempest-ProjectMemberTests-934051372 None] Lock "cinder-66e490d6-629d-4c3d-a3c5-b94d9e754d68-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:33 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa 1G" returned: 0 in 0.821s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153425ce-d5e5-404d-a5e2-1e089c707d48 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:33 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153425ce-d5e5-404d-a5e2-1e089c707d48 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa Jul 08 18:34:33 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (d6227280-ff3b-4827-8d24-cdf2c6bf06b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f34250e-88cb-440f-92e0-f1be9dfc6119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f34250e-88cb-440f-92e0-f1be9dfc6119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54577832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0e63e6-ca48-4c1a-ac88-b76a6a734d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:34Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc1bd5b-86d7-44bd-b264-da05c0bde9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc1bd5b-86d7-44bd-b264-da05c0bde9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eadc2a1-b7a0-4728-b0a8-037f5f3a862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eadc2a1-b7a0-4728-b0a8-037f5f3a862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0e63e6-ca48-4c1a-ac88-b76a6a734d37', 'volume_name': 'volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59889080-1be0-4731-af4e-4b9764c29822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59889080-1be0-4731-af4e-4b9764c29822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0f5199-8fca-4ba3-b5a3-1257a3aeae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:33 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Volume 5e0e63e6-ca48-4c1a-ac88-b76a6a734d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37', 'volume_size': 1} Jul 08 18:34:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:34 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153425ce-d5e5-404d-a5e2-1e089c707d48 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa" returned: 0 in 0.683s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:34 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa is being set with open permissions: ugo+rw Jul 08 18:34:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:34 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa Jul 08 18:34:34 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:34 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa" returned: 0 in 0.624s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:34 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.info Jul 08 18:34:34 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:35 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.info" returned: 0 in 0.647s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:35 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.info is being set with open permissions: ugo+rw Jul 08 18:34:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:35 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.info Jul 08 18:34:35 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:36 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.info" returned: 0 in 0.609s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.245s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.334s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54577832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0e63e6-ca48-4c1a-ac88-b76a6a734d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:34Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Creating volume 5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:36 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:34:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:36 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 1073741824 Jul 08 18:34:36 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:36 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6a8f1cae-92b4-48d8-a0ef-32be68f90332 tempest-ProjectReaderTests-101602282 None] Create snapshot completed successfully Jul 08 18:34:36 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 1073741824" returned: 0 in 0.789s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:37 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 Jul 08 18:34:37 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-fc813d40-c6a7-4832-8799-652d9b42e6fa-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Lock "cinder-fc813d40-c6a7-4832-8799-652d9b42e6fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-153425ce-d5e5-404d-a5e2-1e089c707d48" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-153425ce-d5e5-404d-a5e2-1e089c707d48" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-fc813d40-c6a7-4832-8799-652d9b42e6fa" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-fc813d40-c6a7-4832-8799-652d9b42e6fa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Deleting offline snapshot fc813d40-c6a7-4832-8799-652d9b42e6fa of volume 153425ce-d5e5-404d-a5e2-1e089c707d48 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] snapshot_file for this snap is: volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b46ae3-4d5a-47e2-a30f-cf1c20a69b50]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:37 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa Jul 08 18:34:37 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:37 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" returned: 0 in 0.633s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0f5199-8fca-4ba3-b5a3-1257a3aeae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f96cfe4-bc35-44f1-9832-5bed348ad397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:37 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Volume volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 (5e0e63e6-ca48-4c1a-ac88-b76a6a734d37): created successfully Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f96cfe4-bc35-44f1-9832-5bed348ad397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:37 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (d6227280-ff3b-4827-8d24-cdf2c6bf06b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b025025c-0975-46b3-931e-e7f6695e8e11 tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Creating offline snapshot 05563157-59e9-4836-bb29-2974523a9f44 of volume 5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:34:38 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa" returned: 0 in 0.795s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-153425ce-d5e5-404d-a5e2-1e089c707d48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e34f2-9020-4b37-8a5e-e996910bca6a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa9ca10-6305-499f-9121-8671434ae9f8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:38 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 Jul 08 18:34:38 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:38 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 Jul 08 18:34:38 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:38 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" returned: 0 in 0.766s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:38 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48" returned: 0 in 0.769s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:38 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 1G Jul 08 18:34:38 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:38 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa Jul 08 18:34:38 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:39 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa" returned: 0 in 0.738s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:39 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa Jul 08 18:34:39 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:39 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 1G" returned: 0 in 0.859s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:39 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 Jul 08 18:34:39 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:40 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48.fc813d40-c6a7-4832-8799-652d9b42e6fa" returned: 0 in 0.651s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-fc813d40-c6a7-4832-8799-652d9b42e6fa" released by "_delete_snapshot" :: held 3.069s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-153425ce-d5e5-404d-a5e2-1e089c707d48" released by "delete_snapshot" :: held 3.102s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:40 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Created reservations ['7932dd99-5167-4a36-bf4c-14f54ecb9e0b', '0918e0ed-0f41-4e9b-9d89-01c799779c99', 'f7e9d10e-61ed-4bf0-94a2-ca9dc1265aaf', '33ddb2e9-9ab8-4d35-86af-585fdd50cea3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Delete snapshot completed successfully. Jul 08 18:34:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-67ea801e-29f0-4eb5-b21b-246e2a1efd94 tempest-ProjectReaderTests-101602282 None] Lock "cinder-fc813d40-c6a7-4832-8799-652d9b42e6fa-delete_snapshot" released by "delete_snapshot" :: held 3.266s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:40 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44" returned: 0 in 0.747s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:40 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 is being set with open permissions: ugo+rw Jul 08 18:34:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:40 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 Jul 08 18:34:40 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:41 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44" returned: 0 in 0.618s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:41 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.info Jul 08 18:34:41 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-153425ce-d5e5-404d-a5e2-1e089c707d48-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Lock "cinder-153425ce-d5e5-404d-a5e2-1e089c707d48-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-153425ce-d5e5-404d-a5e2-1e089c707d48" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-153425ce-d5e5-404d-a5e2-1e089c707d48" acquired by "delete_volume" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b82077-835e-4a68-b6a0-541e025f4219]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:41 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 Jul 08 18:34:41 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:41 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.info" returned: 0 in 0.657s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:41 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.info is being set with open permissions: ugo+rw Jul 08 18:34:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:41 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.info Jul 08 18:34:41 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:42 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48" returned: 0 in 0.774s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:42 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48 Jul 08 18:34:42 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:42 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.info" returned: 0 in 0.655s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.391s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ebcd854b-021c-4f5b-bee6-04c056cea09d tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:34:43 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-153425ce-d5e5-404d-a5e2-1e089c707d48" returned: 0 in 0.647s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-153425ce-d5e5-404d-a5e2-1e089c707d48" released by "delete_volume" :: held 1.475s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Created reservations ['c22dc64b-23ea-4efe-bf60-447cf642828b', 'bf069c67-b1c4-49f6-94a7-8d0b08b863fc', 'd6ca5899-762c-491f-ac86-943a8269661e', '4474e151-11c8-446f-84fc-c8cc73041a2a'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:43 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:34:43 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-05563157-59e9-4836-bb29-2974523a9f44-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Lock "cinder-05563157-59e9-4836-bb29-2974523a9f44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-05563157-59e9-4836-bb29-2974523a9f44" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-05563157-59e9-4836-bb29-2974523a9f44" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot 05563157-59e9-4836-bb29-2974523a9f44 of volume 5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dfab6f-e0b9-4643-a636-78b2ae07d879]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:43 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 Jul 08 18:34:43 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:43 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.658s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:43 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Deleted volume successfully. Jul 08 18:34:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-71f0c98c-e36d-4b59-9917-ca9f6a9ee93b tempest-ProjectReaderTests-101602282 None] Lock "cinder-153425ce-d5e5-404d-a5e2-1e089c707d48-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (7cabcd05-2c20-43fd-ace6-cbe669b1f026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a373b5-c4b3-404d-86ed-3da1ee5e1928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a373b5-c4b3-404d-86ed-3da1ee5e1928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1060137408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf32615f-e6b2-42c3-9d75-21b05a659eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:44Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3cd3ba-8b1b-4007-a667-ded9e1a8b3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3cd3ba-8b1b-4007-a667-ded9e1a8b3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54aa3b1-3694-4156-b780-49ef913d8db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54aa3b1-3694-4156-b780-49ef913d8db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf32615f-e6b2-42c3-9d75-21b05a659eb7', 'volume_name': 'volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:44 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e482e11e-5caf-4e7a-bc7d-b64b16cca633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e482e11e-5caf-4e7a-bc7d-b64b16cca633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b845609e-cef1-4b7c-a445-5e7eadeaa1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:44 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Volume bf32615f-e6b2-42c3-9d75-21b05a659eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7', 'volume_size': 1} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1060137408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf32615f-e6b2-42c3-9d75-21b05a659eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:44Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Creating volume bf32615f-e6b2-42c3-9d75-21b05a659eb7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:44 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44" returned: 0 in 0.852s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:34:44 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 1073741824 Jul 08 18:34:44 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f58ddc-2293-45fb-b59a-87d699fe6567]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:44 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 Jul 08 18:34:44 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:45 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" returned: 0 in 0.765s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:45 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 1073741824" returned: 0 in 0.816s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:45 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 Jul 08 18:34:45 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:45 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 Jul 08 18:34:45 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:45 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7" returned: 0 in 0.646s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b845609e-cef1-4b7c-a445-5e7eadeaa1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a6e119-e61b-4193-a5f1-5ef1461d6216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:45 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:45 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Volume volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 (bf32615f-e6b2-42c3-9d75-21b05a659eb7): created successfully Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a6e119-e61b-4193-a5f1-5ef1461d6216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (7cabcd05-2c20-43fd-ace6-cbe669b1f026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44" returned: 0 in 0.746s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:45 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-c3db6740-262f-41cf-80c1-91a7ba0b93d7 tempest-ProjectReaderTests-101602282 None] Created volume successfully. Jul 08 18:34:45 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44 Jul 08 18:34:45 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Creating offline snapshot aff4b532-4e86-4aeb-8dfc-88b157e97dd3 of volume bf32615f-e6b2-42c3-9d75-21b05a659eb7 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e252c9-d9e5-4e21-8f18-c6c7716275c9]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:46 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37.05563157-59e9-4836-bb29-2974523a9f44" returned: 0 in 0.635s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-05563157-59e9-4836-bb29-2974523a9f44" released by "_delete_snapshot" :: held 3.096s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" released by "delete_snapshot" :: held 3.121s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:46 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 Jul 08 18:34:46 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Created reservations ['c41f92b4-50d1-4da4-a485-0419ce77dab7', '87c1613c-3084-4e13-a937-743ec45ca3db', '695eb370-1e9a-43d6-9eeb-92bec8c0b029', 'b87c2d5f-8428-4a47-9885-0ca55ef537b5'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:34:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-53086f6a-4bad-4ff6-be31-cca153b5e9e4 tempest-ProjectMemberTests-934051372 None] Lock "cinder-05563157-59e9-4836-bb29-2974523a9f44-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:47 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7" returned: 0 in 0.731s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:47 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 1G Jul 08 18:34:47 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Lock "cinder-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a4b88-2914-4df5-940b-5b0271c6740a]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:47 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 Jul 08 18:34:47 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:47 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 1G" returned: 0 in 0.762s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:47 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 Jul 08 18:34:47 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:48 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" returned: 0 in 0.730s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:48 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37 Jul 08 18:34:48 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:48 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3" returned: 0 in 0.655s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:48 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 is being set with open permissions: ugo+rw Jul 08 18:34:48 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:48 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 Jul 08 18:34:48 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:49 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" returned: 0 in 0.624s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37" released by "delete_volume" :: held 1.417s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Created reservations ['a4cc4e0a-07ca-4b88-9ca2-ec779cb4c21b', '03a1b7c1-340e-45cf-b156-4b5515a1db2c', '266fc99c-52d7-48df-a425-a0f8ac8964aa', 'ad8bd69e-a451-47ee-9c0d-50736c60d110'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:49 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:34:49 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:49 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3" returned: 0 in 0.665s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:49 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.info Jul 08 18:34:49 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:49 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.671s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:49 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-dbf9becd-6468-4b02-b2cb-6202472996d6 tempest-ProjectMemberTests-934051372 None] Lock "cinder-5e0e63e6-ca48-4c1a-ac88-b76a6a734d37-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:49 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.info" returned: 0 in 0.673s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:49 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.info is being set with open permissions: ugo+rw Jul 08 18:34:49 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:50 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.info Jul 08 18:34:50 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (71daf932-687b-4776-b28f-b02de60ac7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b668535-15a9-4b0f-b84e-25f16657aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b668535-15a9-4b0f-b84e-25f16657aa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263708873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00630d87-d8e8-4d7c-9d61-0fed8335a357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:50Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc216d21-a3b0-4e7c-bb40-6623bd28280d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc216d21-a3b0-4e7c-bb40-6623bd28280d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bae37a3-2e2f-48ed-a4b3-1dd45e18d546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bae37a3-2e2f-48ed-a4b3-1dd45e18d546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00630d87-d8e8-4d7c-9d61-0fed8335a357', 'volume_name': 'volume-00630d87-d8e8-4d7c-9d61-0fed8335a357', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93506f8-7287-472d-85c5-199cddaca830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93506f8-7287-472d-85c5-199cddaca830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c424e53b-125e-42dd-80a2-588c8714640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:50 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Volume 00630d87-d8e8-4d7c-9d61-0fed8335a357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00630d87-d8e8-4d7c-9d61-0fed8335a357', 'volume_size': 1} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:50 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.info" returned: 0 in 0.653s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.233s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-263708873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00630d87-d8e8-4d7c-9d61-0fed8335a357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:50Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Creating volume 00630d87-d8e8-4d7c-9d61-0fed8335a357 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:50 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:34:50 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:50 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 1073741824 Jul 08 18:34:50 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:50 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-dc7e4325-7410-4bb0-abf0-2ffd33b10593 tempest-ProjectReaderTests-101602282 None] Create snapshot completed successfully Jul 08 18:34:51 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 1073741824" returned: 0 in 0.785s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:51 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 Jul 08 18:34:51 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-aff4b532-4e86-4aeb-8dfc-88b157e97dd3-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Lock "cinder-aff4b532-4e86-4aeb-8dfc-88b157e97dd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-bf32615f-e6b2-42c3-9d75-21b05a659eb7" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-bf32615f-e6b2-42c3-9d75-21b05a659eb7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-aff4b532-4e86-4aeb-8dfc-88b157e97dd3" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-aff4b532-4e86-4aeb-8dfc-88b157e97dd3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Deleting offline snapshot aff4b532-4e86-4aeb-8dfc-88b157e97dd3 of volume bf32615f-e6b2-42c3-9d75-21b05a659eb7 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] snapshot_file for this snap is: volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b41bb6-f142-4a65-a691-d37b617f0468]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:51 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:51 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 Jul 08 18:34:51 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:52 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357" returned: 0 in 0.655s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c424e53b-125e-42dd-80a2-588c8714640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00630d87-d8e8-4d7c-9d61-0fed8335a357', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc88b3d0-494c-43b0-99f5-ed8e72d1a439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:52 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Volume volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 (00630d87-d8e8-4d7c-9d61-0fed8335a357): created successfully Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc88b3d0-494c-43b0-99f5-ed8e72d1a439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (71daf932-687b-4776-b28f-b02de60ac7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:52 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5ddcdff0-e9a8-4fc2-90e0-bacd6e0d9c4b tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Creating offline snapshot 03d38505-d502-418e-940e-45ac5a6b9d65 of volume 00630d87-d8e8-4d7c-9d61-0fed8335a357 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:34:52 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3" returned: 0 in 0.781s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[48558da5-2f34-46a8-acf2-33ec7ab76fca]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d14aa2b-b999-49a4-9c1c-6832f5b1c484]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:52 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:52 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 Jul 08 18:34:52 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:52 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 Jul 08 18:34:52 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:53 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7" returned: 0 in 0.765s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:53 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357" returned: 0 in 0.791s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:53 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:53 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 Jul 08 18:34:53 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:53 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 1G Jul 08 18:34:53 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:54 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3" returned: 0 in 0.715s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:54 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3 Jul 08 18:34:54 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:54 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 1G" returned: 0 in 0.788s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:54 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 Jul 08 18:34:54 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:54 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7.aff4b532-4e86-4aeb-8dfc-88b157e97dd3" returned: 0 in 0.645s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-aff4b532-4e86-4aeb-8dfc-88b157e97dd3" released by "_delete_snapshot" :: held 2.998s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-bf32615f-e6b2-42c3-9d75-21b05a659eb7" released by "delete_snapshot" :: held 3.020s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Created reservations ['d459e6a2-4338-4242-9b9c-ce376a612f9a', 'f7c1d579-f6d4-4466-90cc-7c941d3d5e92', '6861bf5a-cd7b-48d6-b5a6-e021dc238f70', '21ea72e9-5c15-4599-94e5-e0cda368e60f'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:54 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65" returned: 0 in 0.681s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:54 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 is being set with open permissions: ugo+rw Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:54 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 Jul 08 18:34:54 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:54 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Delete snapshot completed successfully. Jul 08 18:34:54 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-5142f6c2-8e27-4319-97b7-e315e95a8f03 tempest-ProjectReaderTests-101602282 None] Lock "cinder-aff4b532-4e86-4aeb-8dfc-88b157e97dd3-delete_snapshot" released by "delete_snapshot" :: held 3.185s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:55 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65" returned: 0 in 0.612s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:55 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:55 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.info Jul 08 18:34:55 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-bf32615f-e6b2-42c3-9d75-21b05a659eb7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Lock "cinder-bf32615f-e6b2-42c3-9d75-21b05a659eb7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-bf32615f-e6b2-42c3-9d75-21b05a659eb7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:55 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-bf32615f-e6b2-42c3-9d75-21b05a659eb7" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:56 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd4ae98-1021-4155-8136-fd6d42964535]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:56 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.info" returned: 0 in 0.655s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:56 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.info is being set with open permissions: ugo+rw Jul 08 18:34:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:56 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.info Jul 08 18:34:56 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:56 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 Jul 08 18:34:56 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:56 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.info" returned: 0 in 0.662s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:56 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7" returned: 0 in 0.777s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:56 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:56 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f35e83b2-4f2d-4f7e-a24e-6af3c6361b0d tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:34:56 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7 Jul 08 18:34:56 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:57 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-bf32615f-e6b2-42c3-9d75-21b05a659eb7" returned: 0 in 0.627s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-bf32615f-e6b2-42c3-9d75-21b05a659eb7" released by "delete_volume" :: held 1.466s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Created reservations ['ae036955-b9a5-42e0-86de-649cae4e371a', '256945f8-1fd7-42b3-97a0-c2d58fba150e', 'bb9b0d88-5417-4ebb-afc1-ad086bfdcf7c', '97fd5eac-f029-475a-8702-3c046f05e5f3'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:57 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:34:57 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-03d38505-d502-418e-940e-45ac5a6b9d65-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Lock "cinder-03d38505-d502-418e-940e-45ac5a6b9d65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-00630d87-d8e8-4d7c-9d61-0fed8335a357" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-00630d87-d8e8-4d7c-9d61-0fed8335a357" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-03d38505-d502-418e-940e-45ac5a6b9d65" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-03d38505-d502-418e-940e-45ac5a6b9d65" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot 03d38505-d502-418e-940e-45ac5a6b9d65 of volume 00630d87-d8e8-4d7c-9d61-0fed8335a357 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c79106-d5d2-43d5-bf50-fee707fb5456]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:57 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:57 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 Jul 08 18:34:57 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:58 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.648s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:34:58 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Deleted volume successfully. Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-b7e084bb-9396-473c-bed7-171470804087 tempest-ProjectReaderTests-101602282 None] Lock "cinder-bf32615f-e6b2-42c3-9d75-21b05a659eb7-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:34:58 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65" returned: 0 in 0.769s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00630d87-d8e8-4d7c-9d61-0fed8335a357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4bbad3-7d00-4433-be3c-70cf11bebf1d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (d585b47f-c2b8-4003-a80e-b5585554caeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6767e1-fd3d-474d-8fad-b46af6d5e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6767e1-fd3d-474d-8fad-b46af6d5e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772308538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51cc09b-5fe5-4b03-a199-0206f4fdb7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:59Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86fce91-d034-4b77-b910-fe7c78360c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86fce91-d034-4b77-b910-fe7c78360c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8236306-a58a-4649-bd4e-b590f7401862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8236306-a58a-4649-bd4e-b590f7401862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51cc09b-5fe5-4b03-a199-0206f4fdb7da', 'volume_name': 'volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8a2a98-3d8a-4114-a3b2-d5b6f1520810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8a2a98-3d8a-4114-a3b2-d5b6f1520810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:34:58 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 Jul 08 18:34:58 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f0188d-e3b2-4c20-8348-47b29692ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:34:58 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Volume a51cc09b-5fe5-4b03-a199-0206f4fdb7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da', 'volume_size': 1} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772308538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51cc09b-5fe5-4b03-a199-0206f4fdb7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:34:59Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Creating volume a51cc09b-5fe5-4b03-a199-0206f4fdb7da {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:34:58 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:34:58 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:58 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da 1073741824 Jul 08 18:34:58 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:59 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357" returned: 0 in 0.726s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:59 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 Jul 08 18:34:59 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:34:59 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 08 18:34:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da 1073741824" returned: 0 in 0.830s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:34:59 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:34:59 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da Jul 08 18:34:59 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:00 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65" returned: 0 in 0.722s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:00 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65 Jul 08 18:35:00 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:00 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" returned: 0 in 0.633s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f0188d-e3b2-4c20-8348-47b29692ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcaa6b62-0b99-4fb3-a4d0-f3b262680d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:00 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Volume volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da (a51cc09b-5fe5-4b03-a199-0206f4fdb7da): created successfully Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcaa6b62-0b99-4fb3-a4d0-f3b262680d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (d585b47f-c2b8-4003-a80e-b5585554caeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-27aede4e-42a8-4d0b-b3b4-cc1904111f4c tempest-ProjectReaderTests-101602282 None] Created volume successfully. Jul 08 18:35:00 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357.03d38505-d502-418e-940e-45ac5a6b9d65" returned: 0 in 0.653s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-03d38505-d502-418e-940e-45ac5a6b9d65" released by "_delete_snapshot" :: held 2.971s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-00630d87-d8e8-4d7c-9d61-0fed8335a357" released by "delete_snapshot" :: held 2.996s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Created reservations ['345cd2c1-fe7a-4d22-a92e-781d5a232e59', '44138086-e0cd-4b82-af5a-575de6eea88e', 'ed81c8e6-116c-4d6a-b470-f0351770ec9d', '40c42c54-8198-4726-bcb6-ed85b3dea39e'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Creating offline snapshot befbe0fd-6f0d-4888-85df-25d96e8a247c of volume a51cc09b-5fe5-4b03-a199-0206f4fdb7da {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d042b-d4dc-4b83-be65-69fb271c9cb5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:00 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:35:00 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-539beb18-28e5-4f89-b029-470f2afdb23d tempest-ProjectMemberTests-934051372 None] Lock "cinder-03d38505-d502-418e-940e-45ac5a6b9d65-delete_snapshot" released by "delete_snapshot" :: held 3.182s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:00 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da Jul 08 18:35:00 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:01 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" returned: 0 in 0.725s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:01 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:01 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c 1G Jul 08 18:35:01 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-00630d87-d8e8-4d7c-9d61-0fed8335a357-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Lock "cinder-00630d87-d8e8-4d7c-9d61-0fed8335a357-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-00630d87-d8e8-4d7c-9d61-0fed8335a357" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:01 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-00630d87-d8e8-4d7c-9d61-0fed8335a357" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bcd9b2-9b9f-4fe1-b141-b97d00123b0f]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:02 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 Jul 08 18:35:02 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:02 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c 1G" returned: 0 in 0.798s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:02 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c Jul 08 18:35:02 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:02 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:35:02 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:02 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357" returned: 0 in 0.781s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:02 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357 Jul 08 18:35:02 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:03 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.711s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:35:03 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c" returned: 0 in 0.797s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:03 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c is being set with open permissions: ugo+rw Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:03 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c Jul 08 18:35:03 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:03 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-00630d87-d8e8-4d7c-9d61-0fed8335a357" returned: 0 in 0.668s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-00630d87-d8e8-4d7c-9d61-0fed8335a357" released by "delete_volume" :: held 1.507s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Created reservations ['61c48840-40bd-48e1-a855-c570e89ce14a', '9df5d869-951d-49a8-a599-1db40dc7433d', '9fd19e8a-2515-4916-a155-c2a4dd432232', '054e0eb8-9df6-406e-b015-7819579405f2'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:03 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:35:03 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:03 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c" returned: 0 in 0.706s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:03 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.info Jul 08 18:35:03 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:04 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.713s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:04 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-04b82bae-9745-4e1e-bad6-f56d1cf018be tempest-ProjectMemberTests-934051372 None] Lock "cinder-00630d87-d8e8-4d7c-9d61-0fed8335a357-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (9e232197-63a0-4039-a942-7302d8f7c9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f5f71d-30f7-476f-8194-2b22fc9016cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f5f71d-30f7-476f-8194-2b22fc9016cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074373993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46230d3c-29e4-488d-9149-556faacf2614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:05Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818fd9fd-a760-44df-8b35-8f99799c052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818fd9fd-a760-44df-8b35-8f99799c052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e256f08-6c9e-46b4-9524-bb22b8b88706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e256f08-6c9e-46b4-9524-bb22b8b88706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46230d3c-29e4-488d-9149-556faacf2614', 'volume_name': 'volume-46230d3c-29e4-488d-9149-556faacf2614', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:04 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd12dc5-9a1c-4214-996c-47914e171765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd12dc5-9a1c-4214-996c-47914e171765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecee591-3277-4ebd-bd61-82592d7d2aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:04 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Volume 46230d3c-29e4-488d-9149-556faacf2614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46230d3c-29e4-488d-9149-556faacf2614', 'volume_size': 1} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.info" returned: 0 in 0.759s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:04 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.info is being set with open permissions: ugo+rw Jul 08 18:35:04 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:04 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.info Jul 08 18:35:04 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:05 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.info" returned: 0 in 0.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.583s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.731s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074373993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46230d3c-29e4-488d-9149-556faacf2614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:05Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Creating volume 46230d3c-29e4-488d-9149-556faacf2614 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:05 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:35:05 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:05 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 1073741824 Jul 08 18:35:05 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:05 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-145d399a-860c-4ebd-bb81-61a4e59c876d tempest-ProjectReaderTests-101602282 None] Create snapshot completed successfully Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-befbe0fd-6f0d-4888-85df-25d96e8a247c-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Lock "cinder-befbe0fd-6f0d-4888-85df-25d96e8a247c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-befbe0fd-6f0d-4888-85df-25d96e8a247c" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-befbe0fd-6f0d-4888-85df-25d96e8a247c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Deleting offline snapshot befbe0fd-6f0d-4888-85df-25d96e8a247c of volume a51cc09b-5fe5-4b03-a199-0206f4fdb7da {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] snapshot_file for this snap is: volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[748f57a5-0f66-4a84-9c64-db66e8e883ad]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:06 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c Jul 08 18:35:06 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:06 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 1073741824" returned: 0 in 0.913s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:06 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 Jul 08 18:35:06 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:06 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c" returned: 0 in 0.779s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30acb0-6a8e-4527-a4b2-c3a53b28b3aa]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:06 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:07 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da Jul 08 18:35:07 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:07 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614" returned: 0 in 0.744s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecee591-3277-4ebd-bd61-82592d7d2aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46230d3c-29e4-488d-9149-556faacf2614', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74817556-4c4b-499b-aa8c-98802b32bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:07 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Volume volume-46230d3c-29e4-488d-9149-556faacf2614 (46230d3c-29e4-488d-9149-556faacf2614): created successfully Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74817556-4c4b-499b-aa8c-98802b32bd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (9e232197-63a0-4039-a942-7302d8f7c9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:07 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-757431be-0e46-4940-8b71-f49d9a002d9c tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:35:07 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" returned: 0 in 0.769s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:07 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c Jul 08 18:35:07 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Creating offline snapshot d3b335c6-9754-408f-94cf-e81c89c7507c of volume 46230d3c-29e4-488d-9149-556faacf2614 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8be4ea-2359-4179-b57d-65864460a9c8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:07 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:08 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 Jul 08 18:35:08 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:08 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c" returned: 0 in 0.709s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:08 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c Jul 08 18:35:08 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:08 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614" returned: 0 in 0.808s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:08 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:08 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c 1G Jul 08 18:35:08 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:09 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da.befbe0fd-6f0d-4888-85df-25d96e8a247c" returned: 0 in 0.637s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-befbe0fd-6f0d-4888-85df-25d96e8a247c" released by "_delete_snapshot" :: held 2.987s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" released by "delete_snapshot" :: held 3.013s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:09 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Created reservations ['de8f06d2-7da8-4673-91cd-671c9036c863', 'c8f42eee-ce4b-4294-b12e-3aa5ff54d4b8', '0d5ffd90-99f4-409a-ae55-0f716538e79e', '4f263cbd-dd28-48e8-8572-dba85aed98db'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:09 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Delete snapshot completed successfully. Jul 08 18:35:09 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-66907502-b3d0-4fa0-9ef9-6adc22b40298 tempest-ProjectReaderTests-101602282 None] Lock "cinder-befbe0fd-6f0d-4888-85df-25d96e8a247c-delete_snapshot" released by "delete_snapshot" :: held 3.156s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:09 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c 1G" returned: 0 in 0.813s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:09 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46230d3c-29e4-488d-9149-556faacf2614 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:09 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46230d3c-29e4-488d-9149-556faacf2614 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c Jul 08 18:35:09 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:10 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46230d3c-29e4-488d-9149-556faacf2614 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c" returned: 0 in 0.698s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:10 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c is being set with open permissions: ugo+rw Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:10 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c Jul 08 18:35:10 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-a51cc09b-5fe5-4b03-a199-0206f4fdb7da-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Lock "cinder-a51cc09b-5fe5-4b03-a199-0206f4fdb7da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af7dd3-94ad-40bd-b0ef-18143f6866e5]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:10 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da Jul 08 18:35:10 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:10 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c" returned: 0 in 0.680s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:10 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:10 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.info Jul 08 18:35:10 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:11 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" returned: 0 in 0.759s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:11 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da Jul 08 18:35:11 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:11 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.info" returned: 0 in 0.649s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:11 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.info is being set with open permissions: ugo+rw Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:11 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.info Jul 08 18:35:11 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:11 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" returned: 0 in 0.656s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-a51cc09b-5fe5-4b03-a199-0206f4fdb7da" released by "delete_volume" :: held 1.478s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Created reservations ['35ef2a30-ef33-4bf2-a299-c15eb851aedb', '161bab02-81ac-4e2e-87a4-dcfb6c862173', '4886c93a-9d8f-4e40-9c35-b16d758dd854', '88afe171-a6d3-4ffa-983f-a89f69c142b8'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:11 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:12 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:35:12 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:12 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.info" returned: 0 in 0.641s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.383s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-ec207387-a15e-463d-84c8-0a0c9eebf32c tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:35:12 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.646s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:12 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Deleted volume successfully. Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-324a5eb6-7ead-46dd-87b2-9fec46085721 tempest-ProjectReaderTests-101602282 None] Lock "cinder-a51cc09b-5fe5-4b03-a199-0206f4fdb7da-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (eb54a1a3-8d13-44a4-a299-005c2331ad5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404dc9a6-a8d8-4405-80b2-6bcc2819a257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404dc9a6-a8d8-4405-80b2-6bcc2819a257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467481864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb49e8a-ab2b-4e44-b698-574f9a1d6b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:13Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d7d2f9-65f2-4c42-b8fe-894ef34852f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d7d2f9-65f2-4c42-b8fe-894ef34852f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89719fcb-ead6-4344-908b-ef2adeed0c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89719fcb-ead6-4344-908b-ef2adeed0c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb49e8a-ab2b-4e44-b698-574f9a1d6b46', 'volume_name': 'volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1026cc85-d05b-460c-880d-5acbb2d3c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1026cc85-d05b-460c-880d-5acbb2d3c00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a201b4-8b11-4536-8868-fb9cdd8a9751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:12 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Volume 0bb49e8a-ab2b-4e44-b698-574f9a1d6b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46', 'volume_size': 1} Jul 08 18:35:12 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467481864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb49e8a-ab2b-4e44-b698-574f9a1d6b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:13Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Creating volume 0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:13 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:13 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 1073741824 Jul 08 18:35:13 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-d3b335c6-9754-408f-94cf-e81c89c7507c-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Lock "cinder-d3b335c6-9754-408f-94cf-e81c89c7507c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-46230d3c-29e4-488d-9149-556faacf2614" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-46230d3c-29e4-488d-9149-556faacf2614" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-d3b335c6-9754-408f-94cf-e81c89c7507c" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-d3b335c6-9754-408f-94cf-e81c89c7507c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot d3b335c6-9754-408f-94cf-e81c89c7507c of volume 46230d3c-29e4-488d-9149-556faacf2614 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5198f83-2a2c-4c80-b57e-4b5c3606580d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:13 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c Jul 08 18:35:13 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:13 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 1073741824" returned: 0 in 0.827s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:13 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:13 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 Jul 08 18:35:13 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:14 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c" returned: 0 in 0.891s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46230d3c-29e4-488d-9149-556faacf2614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e7f477-3078-40dc-bf1a-77222e713a58]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:14 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 Jul 08 18:35:14 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:14 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" returned: 0 in 0.677s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a201b4-8b11-4536-8868-fb9cdd8a9751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57508374-263a-4706-a2f4-70e9a604840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:14 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Volume volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 (0bb49e8a-ab2b-4e44-b698-574f9a1d6b46): created successfully Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57508374-263a-4706-a2f4-70e9a604840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (eb54a1a3-8d13-44a4-a299-005c2331ad5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:14 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5166eee4-d7cc-44a5-8bff-7fe8f116e8a2 tempest-ProjectReaderTests-101602282 None] Created volume successfully. Jul 08 18:35:14 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614" returned: 0 in 0.754s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:14 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:14 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c Jul 08 18:35:14 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:15 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Creating offline snapshot 0829125f-3a15-430e-a8aa-38a60ad3bd3a of volume 0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:35:15 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[285eb7f3-401d-43ac-8b94-2d86b869cbc0]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:15 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 Jul 08 18:35:15 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:15 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c" returned: 0 in 0.772s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:15 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:15 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c Jul 08 18:35:15 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:16 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" returned: 0 in 0.792s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:16 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a 1G Jul 08 18:35:16 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:16 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614.d3b335c6-9754-408f-94cf-e81c89c7507c" returned: 0 in 0.643s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-d3b335c6-9754-408f-94cf-e81c89c7507c" released by "_delete_snapshot" :: held 3.172s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-46230d3c-29e4-488d-9149-556faacf2614" released by "delete_snapshot" :: held 3.199s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Created reservations ['190726f4-6dc5-409b-872e-a68084e45c28', '7d4e188b-3686-4ab4-897f-1cb9dd695004', 'e283626e-20a0-4879-a3f7-a4f5fcb437e8', '22941d0f-a9ac-4f6b-abbe-6219b361f212'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:16 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-2202b6b0-e3d2-4cdb-8501-a80ce3911d3c tempest-ProjectMemberTests-934051372 None] Lock "cinder-d3b335c6-9754-408f-94cf-e81c89c7507c-delete_snapshot" released by "delete_snapshot" :: held 3.346s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:16 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a 1G" returned: 0 in 0.849s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:16 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:16 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a Jul 08 18:35:16 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-46230d3c-29e4-488d-9149-556faacf2614-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Lock "cinder-46230d3c-29e4-488d-9149-556faacf2614-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-46230d3c-29e4-488d-9149-556faacf2614" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:17 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-46230d3c-29e4-488d-9149-556faacf2614" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:17 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f63d89-42a7-4e62-afd0-f79e89b58b38]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:17 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 Jul 08 18:35:17 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:17 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a" returned: 0 in 0.691s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:17 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a is being set with open permissions: ugo+rw Jul 08 18:35:17 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:17 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a Jul 08 18:35:17 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:18 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a" returned: 0 in 0.607s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:18 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614" returned: 0 in 0.762s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:18 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614 Jul 08 18:35:18 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:18 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.info Jul 08 18:35:18 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:18 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-46230d3c-29e4-488d-9149-556faacf2614" returned: 0 in 0.632s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-46230d3c-29e4-488d-9149-556faacf2614" released by "delete_volume" :: held 1.458s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:18 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.info" returned: 0 in 0.647s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:18 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.info is being set with open permissions: ugo+rw Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:18 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.info Jul 08 18:35:18 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Created reservations ['67d6563f-83b2-4311-b9dc-d73cc21cac14', '379dc5d0-2474-44f7-b35d-cd42439a7e03', 'a8968002-765d-40fc-a0b3-f747a9f0d526', 'c552fae6-aba6-495b-b891-f3210f145c4b'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:18 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:19 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:35:19 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:19 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.info" returned: 0 in 0.638s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.329s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:19 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-1ef7e3c9-81c7-4dfa-b8b0-4399b9b2b308 tempest-ProjectReaderTests-101602282 None] Create snapshot completed successfully Jul 08 18:35:19 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:19 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.644s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:19 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:19 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:35:19 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-80d01c8d-b437-4955-9d6f-5d857ca17266 tempest-ProjectMemberTests-934051372 None] Lock "cinder-46230d3c-29e4-488d-9149-556faacf2614-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:19 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (784974ac-af40-4a7c-a5ef-3d4d013dae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3f939e-1646-4135-ad45-ef8e480e5d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3f939e-1646-4135-ad45-ef8e480e5d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352739899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dea9787-1285-4361-aa53-1d611388611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:20Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fcf04d-c8a1-4be7-907e-f8024dba46e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fcf04d-c8a1-4be7-907e-f8024dba46e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685550c5-c4ec-476d-b082-b00bc97f3588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685550c5-c4ec-476d-b082-b00bc97f3588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dea9787-1285-4361-aa53-1d611388611c', 'volume_name': 'volume-9dea9787-1285-4361-aa53-1d611388611c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a151ef2-e3ee-4b0e-83d5-3445724fb1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a151ef2-e3ee-4b0e-83d5-3445724fb1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b334e0d-0fcf-4568-b636-ddf0adf23227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:20 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Volume 9dea9787-1285-4361-aa53-1d611388611c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dea9787-1285-4361-aa53-1d611388611c', 'volume_size': 1} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352739899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dea9787-1285-4361-aa53-1d611388611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:20Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Creating volume 9dea9787-1285-4361-aa53-1d611388611c {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:20 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:20 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c 1073741824 Jul 08 18:35:20 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-0829125f-3a15-430e-a8aa-38a60ad3bd3a-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Lock "cinder-0829125f-3a15-430e-a8aa-38a60ad3bd3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-0829125f-3a15-430e-a8aa-38a60ad3bd3a" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0829125f-3a15-430e-a8aa-38a60ad3bd3a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Deleting offline snapshot 0829125f-3a15-430e-a8aa-38a60ad3bd3a of volume 0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] snapshot_file for this snap is: volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[536ed1ef-2003-44cc-99fc-2ab0189baa7c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:20 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a Jul 08 18:35:20 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:20 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c 1073741824" returned: 0 in 0.790s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:20 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:20 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c Jul 08 18:35:20 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:21 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a" returned: 0 in 0.778s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ea669-bb58-48ec-9cd9-ea4321a8ce23]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:21 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 Jul 08 18:35:21 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:21 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c" returned: 0 in 0.684s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b334e0d-0fcf-4568-b636-ddf0adf23227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dea9787-1285-4361-aa53-1d611388611c', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8465744d-8fab-4dd2-9a05-ed5200921f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:21 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Volume volume-9dea9787-1285-4361-aa53-1d611388611c (9dea9787-1285-4361-aa53-1d611388611c): created successfully Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8465744d-8fab-4dd2-9a05-ed5200921f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:21 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (784974ac-af40-4a7c-a5ef-3d4d013dae5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:21 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-13b74abb-35ce-41f2-a4b4-ef075b1dc971 tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:35:22 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" returned: 0 in 0.753s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:22 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a Jul 08 18:35:22 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Creating offline snapshot cdbea670-69f8-4ad5-9d39-81ba4d5100ed of volume 9dea9787-1285-4361-aa53-1d611388611c {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c2e64a-c48e-42a6-9d3c-1085cb533c00]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:22 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c Jul 08 18:35:22 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:22 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a" returned: 0 in 0.736s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:22 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:22 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a Jul 08 18:35:22 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:23 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c" returned: 0 in 0.783s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:23 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed 1G Jul 08 18:35:23 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:23 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46.0829125f-3a15-430e-a8aa-38a60ad3bd3a" returned: 0 in 0.610s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0829125f-3a15-430e-a8aa-38a60ad3bd3a" released by "_delete_snapshot" :: held 2.974s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" released by "delete_snapshot" :: held 2.995s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=151,cinder:SELECT=112,cinder:DELETE=11,cinder:INSERT=42 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=112,cinder:INSERT=38,cinder:UPDATE=142,cinder:DELETE=14 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Created reservations ['db95b769-e384-4c2f-939b-7f39c5069775', 'e4ac4840-40b6-40ff-aff0-381bc299c2db', '7a9d6722-e0bc-4c8e-9750-62186b36c403', '3c12b14b-b01c-4be1-bbfa-4659de88f5cc'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:23 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Delete snapshot completed successfully. Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-d1aec55c-8465-499d-8a4d-3a9e2a1be1e8 tempest-ProjectReaderTests-101602282 None] Lock "cinder-0829125f-3a15-430e-a8aa-38a60ad3bd3a-delete_snapshot" released by "delete_snapshot" :: held 3.150s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:23 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed 1G" returned: 0 in 0.791s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:23 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dea9787-1285-4361-aa53-1d611388611c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:23 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dea9787-1285-4361-aa53-1d611388611c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed Jul 08 18:35:23 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:24 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dea9787-1285-4361-aa53-1d611388611c -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed" returned: 0 in 0.680s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:24 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed is being set with open permissions: ugo+rw Jul 08 18:35:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:24 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed Jul 08 18:35:24 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Lock "cinder-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:24 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" acquired by "delete_volume" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:24 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f264aca-b1cf-4718-a9d1-251d0f956004]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:24 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 Jul 08 18:35:24 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:25 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed" returned: 0 in 0.652s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:25 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.info Jul 08 18:35:25 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:25 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" returned: 0 in 0.819s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:25 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46 Jul 08 18:35:25 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:25 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.info" returned: 0 in 0.769s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:25 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.info is being set with open permissions: ugo+rw Jul 08 18:35:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:25 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.info Jul 08 18:35:25 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:26 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" returned: 0 in 0.667s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46" released by "delete_volume" :: held 1.561s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Created reservations ['62f269e5-f78a-4811-947c-b807a024b278', '88670196-ecef-44ca-bdee-cd2f4b29d280', '4439f318-0400-44ee-ab37-aaea22c9018a', '0d5bf136-b102-4bd7-8656-21eee5d8b213'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:26 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:35:26 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:26 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.info" returned: 0 in 0.663s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.427s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:26 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-24b6f021-3b39-43f2-89b4-9ac0346ce57c tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:35:27 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.695s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:27 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Deleted volume successfully. Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-929813a9-d3d0-47e2-9424-5fdbbc57792b tempest-ProjectReaderTests-101602282 None] Lock "cinder-0bb49e8a-ab2b-4e44-b698-574f9a1d6b46-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (35254cbf-1bbc-4982-b55d-66e35c0fabc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28e661b-702a-40cd-8a1d-6108cfc0d754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28e661b-702a-40cd-8a1d-6108cfc0d754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352798842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9c250e-695e-4d0a-b6eb-fde3670de1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:27Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a537075-6695-4672-b7a6-07a3f94a6846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a537075-6695-4672-b7a6-07a3f94a6846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63657294-065a-4be5-83ad-ebe1a2d7b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63657294-065a-4be5-83ad-ebe1a2d7b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9c250e-695e-4d0a-b6eb-fde3670de1ae', 'volume_name': 'volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87cd121-18c1-428e-a9d0-c5bb47c1534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87cd121-18c1-428e-a9d0-c5bb47c1534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eba8774-7450-4259-9370-8fef5625a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:27 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Volume 0e9c250e-695e-4d0a-b6eb-fde3670de1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae', 'volume_size': 1} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352798842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9c250e-695e-4d0a-b6eb-fde3670de1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e824694d00674cf7a4b815877cacb0d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:27Z,use_quota=True,user_id='d9bf9db995904e58b832bea38c18a358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Creating volume 0e9c250e-695e-4d0a-b6eb-fde3670de1ae {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:27 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:27 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae 1073741824 Jul 08 18:35:27 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-cdbea670-69f8-4ad5-9d39-81ba4d5100ed-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Lock "cinder-cdbea670-69f8-4ad5-9d39-81ba4d5100ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-9dea9787-1285-4361-aa53-1d611388611c" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-9dea9787-1285-4361-aa53-1d611388611c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-cdbea670-69f8-4ad5-9d39-81ba4d5100ed" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-cdbea670-69f8-4ad5-9d39-81ba4d5100ed" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot cdbea670-69f8-4ad5-9d39-81ba4d5100ed of volume 9dea9787-1285-4361-aa53-1d611388611c {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a616702-f329-4157-83a0-08d721108a9b]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:27 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed Jul 08 18:35:27 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:28 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae 1073741824" returned: 0 in 0.802s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:28 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae Jul 08 18:35:28 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:28 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed" returned: 0 in 0.762s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dea9787-1285-4361-aa53-1d611388611c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[75059f8c-5ab6-4b99-8b76-f6ed81895c66]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:28 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c Jul 08 18:35:28 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:28 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" returned: 0 in 0.617s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eba8774-7450-4259-9370-8fef5625a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22507c1-e4ea-4d43-922f-80c2d0168e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:28 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Volume volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae (0e9c250e-695e-4d0a-b6eb-fde3670de1ae): created successfully Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22507c1-e4ea-4d43-922f-80c2d0168e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:28 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Flow 'volume_create_manager' (35254cbf-1bbc-4982-b55d-66e35c0fabc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:28 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-06ad7aad-b70e-4776-a155-2c695881cca6 tempest-ProjectReaderTests-101602282 None] Created volume successfully. Jul 08 18:35:29 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c" returned: 0 in 0.743s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:29 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed Jul 08 18:35:29 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Creating offline snapshot 894d4377-4782-450c-9fcc-49b8d0dffc30 of volume 0e9c250e-695e-4d0a-b6eb-fde3670de1ae {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f40f7d-4e1e-46c6-be2c-97b5dd5184c0]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:29 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae Jul 08 18:35:29 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:29 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed" returned: 0 in 0.727s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:29 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed Jul 08 18:35:29 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:30 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" returned: 0 in 0.747s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:30 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 1G Jul 08 18:35:30 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:30 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c.cdbea670-69f8-4ad5-9d39-81ba4d5100ed" returned: 0 in 0.621s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-cdbea670-69f8-4ad5-9d39-81ba4d5100ed" released by "_delete_snapshot" :: held 2.950s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-9dea9787-1285-4361-aa53-1d611388611c" released by "delete_snapshot" :: held 2.970s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Created reservations ['917661cc-813a-422f-a6f3-93564f12b59a', '3cf4be45-26d1-4fdb-88b4-634d546b826a', 'fb88f3bb-ba1e-447b-a1ea-7a4ba8f1a1d7', 'c0d83f18-1fd5-4847-a7cf-c0ca9695c4cf'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:30 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6daa1a92-fee0-409d-8488-3e0efb2b02ae tempest-ProjectMemberTests-934051372 None] Lock "cinder-cdbea670-69f8-4ad5-9d39-81ba4d5100ed-delete_snapshot" released by "delete_snapshot" :: held 3.120s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-9dea9787-1285-4361-aa53-1d611388611c-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Lock "cinder-9dea9787-1285-4361-aa53-1d611388611c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-9dea9787-1285-4361-aa53-1d611388611c" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-9dea9787-1285-4361-aa53-1d611388611c" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3147ad-b085-4b9b-9019-febcf6da1622]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:30 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c Jul 08 18:35:30 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:31 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 1G" returned: 0 in 0.818s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:31 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 Jul 08 18:35:31 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:31 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c" returned: 0 in 0.765s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:31 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c Jul 08 18:35:31 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:31 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30" returned: 0 in 0.657s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:31 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 is being set with open permissions: ugo+rw Jul 08 18:35:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:31 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 Jul 08 18:35:31 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:32 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-9dea9787-1285-4361-aa53-1d611388611c" returned: 0 in 0.645s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-9dea9787-1285-4361-aa53-1d611388611c" released by "delete_volume" :: held 1.461s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Created reservations ['3dc699f5-b977-490a-9f98-f438b8c7508c', '398b6b52-7191-472a-9e88-3cee3d7cb7ae', '96edebbf-ed02-4bf3-a9bc-86942c29bdc2', 'a3554e63-9c7e-4da2-953c-1bff5c1403e5'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:32 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:35:32 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:32 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30" returned: 0 in 0.619s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:32 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.info Jul 08 18:35:32 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:33 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.670s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:33 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-50455fa0-e41b-4382-9fc6-933dbba9efd3 tempest-ProjectMemberTests-934051372 None] Lock "cinder-9dea9787-1285-4361-aa53-1d611388611c-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:33 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.info" returned: 0 in 0.636s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:33 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.info is being set with open permissions: ugo+rw Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:33 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.info Jul 08 18:35:33 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (f49a5ac2-5d6c-491d-b81b-8198da2300d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d78e8af-d41b-4b5a-93c5-8432df135cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d78e8af-d41b-4b5a-93c5-8432df135cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966525619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeee7f9-150f-4cf8-8f70-4fb96cb56f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:33Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256d9a97-7e30-4115-aea4-af69dc73cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256d9a97-7e30-4115-aea4-af69dc73cf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b622af2-08af-4ce7-ae37-68aa4373792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b622af2-08af-4ce7-ae37-68aa4373792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edeee7f9-150f-4cf8-8f70-4fb96cb56f42', 'volume_name': 'volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2139b29f-d06e-45f7-b3fe-93a5776716ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2139b29f-d06e-45f7-b3fe-93a5776716ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c771bab-7d3c-4aba-9512-570343118362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:33 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Volume edeee7f9-150f-4cf8-8f70-4fb96cb56f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42', 'volume_size': 1} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:33 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.info" returned: 0 in 0.671s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966525619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeee7f9-150f-4cf8-8f70-4fb96cb56f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0265abe27384414b9ceceeb3452d2854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:35:33Z,use_quota=True,user_id='8ee65ce15e224acc87951f782ff65d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Creating volume edeee7f9-150f-4cf8-8f70-4fb96cb56f42 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:35:33 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:35:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:33 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 1073741824 Jul 08 18:35:33 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:33 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-f70f28af-03ac-4624-b819-428900e9e74e tempest-ProjectReaderTests-101602282 None] Create snapshot completed successfully Jul 08 18:35:34 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 1073741824" returned: 0 in 0.784s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:34 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 Jul 08 18:35:34 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-894d4377-4782-450c-9fcc-49b8d0dffc30-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Lock "cinder-894d4377-4782-450c-9fcc-49b8d0dffc30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-894d4377-4782-450c-9fcc-49b8d0dffc30" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-894d4377-4782-450c-9fcc-49b8d0dffc30" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Deleting offline snapshot 894d4377-4782-450c-9fcc-49b8d0dffc30 of volume 0e9c250e-695e-4d0a-b6eb-fde3670de1ae {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] snapshot_file for this snap is: volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d4b9ea-48e0-467b-bb8e-553c92347935]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:34 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:35 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 Jul 08 18:35:35 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:35 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" returned: 0 in 0.640s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c771bab-7d3c-4aba-9512-570343118362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f566f7f9-0827-4018-92c7-0f7295ea2eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:35:35 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Volume volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 (edeee7f9-150f-4cf8-8f70-4fb96cb56f42): created successfully Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f566f7f9-0827-4018-92c7-0f7295ea2eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Flow 'volume_create_manager' (f49a5ac2-5d6c-491d-b81b-8198da2300d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:35:35 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-2677fde4-b6ff-4e43-ad75-5b7789b9f90d tempest-ProjectMemberTests-934051372 None] Created volume successfully. Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Creating offline snapshot 03f673a8-4498-4a8d-a768-dfee8a53ad5c of volume edeee7f9-150f-4cf8-8f70-4fb96cb56f42 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[37343501-6085-4ff2-a41f-7a98f0537ae1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:35 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30" returned: 0 in 0.773s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beabc5b-f1a9-4b4c-9410-7f5c9b6938e8]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:35 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:35 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 Jul 08 18:35:35 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:35 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae Jul 08 18:35:35 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:36 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" returned: 0 in 0.729s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:36 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c 1G Jul 08 18:35:36 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:36 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" returned: 0 in 0.742s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:36 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:36 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 Jul 08 18:35:36 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:37 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:37 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c 1G" returned: 0 in 0.778s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30" returned: 0 in 0.715s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:37 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c Jul 08 18:35:37 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:37 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30 Jul 08 18:35:37 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:37 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae.894d4377-4782-450c-9fcc-49b8d0dffc30" returned: 0 in 0.631s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-894d4377-4782-450c-9fcc-49b8d0dffc30" released by "_delete_snapshot" :: held 2.954s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:37 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c" returned: 0 in 0.675s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:37 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c is being set with open permissions: ugo+rw Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" released by "delete_snapshot" :: held 2.985s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:37 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c Jul 08 18:35:37 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Created reservations ['67f6c57a-8456-4b4c-838f-64b3c6127e48', 'e4664c6c-a6bf-4d4f-907b-f7ca084b9dad', '8d689d7c-25a0-4f39-8b4c-d4ac5d2fe5d2', 'acf7914c-7507-45dc-b49f-2f2146d8673b'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:37 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Delete snapshot completed successfully. Jul 08 18:35:37 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-49dc9fcb-b21e-424f-88bf-44b578f0fcc0 tempest-ProjectReaderTests-101602282 None] Lock "cinder-894d4377-4782-450c-9fcc-49b8d0dffc30-delete_snapshot" released by "delete_snapshot" :: held 3.122s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-0e9c250e-695e-4d0a-b6eb-fde3670de1ae-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Lock "cinder-0e9c250e-695e-4d0a-b6eb-fde3670de1ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Acquiring lock "cinder-quobyte-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab7689b-11c5-4452-839e-c747702c2784]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:38 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae Jul 08 18:35:38 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:38 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c" returned: 0 in 0.639s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:38 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.info Jul 08 18:35:38 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:38 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" returned: 0 in 0.749s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:38 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae Jul 08 18:35:38 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:39 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.info" returned: 0 in 0.633s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:39 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.info is being set with open permissions: ugo+rw Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:39 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.info Jul 08 18:35:39 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:39 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" returned: 0 in 0.639s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Lock "cinder-quobyte-0e9c250e-695e-4d0a-b6eb-fde3670de1ae" released by "delete_volume" :: held 1.441s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Created reservations ['be8dfbff-6fa5-44a1-8894-bde7ceb67d73', 'fca8e1c9-c92d-4968-a304-52c4908e5d2d', '7d04db98-bd25-426f-aa4a-7745c8366949', '7f8252a4-564f-4957-81f6-7c727ae1fe16'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:39 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:35:39 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:39 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.info" returned: 0 in 0.624s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.154s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:39 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5d0abeaf-e52d-4247-ab90-262274eee888 tempest-ProjectMemberTests-934051372 None] Create snapshot completed successfully Jul 08 18:35:40 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.644s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:40 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:40 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Deleted volume successfully. Jul 08 18:35:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-6b62d633-da1f-4341-90d6-0c44333e5a45 tempest-ProjectReaderTests-101602282 None] Lock "cinder-0e9c250e-695e-4d0a-b6eb-fde3670de1ae-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-03f673a8-4498-4a8d-a768-dfee8a53ad5c-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Lock "cinder-03f673a8-4498-4a8d-a768-dfee8a53ad5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:40 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-03f673a8-4498-4a8d-a768-dfee8a53ad5c" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-03f673a8-4498-4a8d-a768-dfee8a53ad5c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Deleting offline snapshot 03f673a8-4498-4a8d-a768-dfee8a53ad5c of volume edeee7f9-150f-4cf8-8f70-4fb96cb56f42 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] snapshot_file for this snap is: volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[92205245-09c8-4dc0-91f2-8958c50256cb]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:41 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c Jul 08 18:35:41 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:41 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c" returned: 0 in 0.900s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4049e-ecf7-43dd-9e5f-eedfa93c0713]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:42 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 Jul 08 18:35:42 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:42 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" returned: 0 in 0.782s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:42 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c Jul 08 18:35:42 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:43 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c" returned: 0 in 0.766s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:43 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c Jul 08 18:35:43 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:44 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42.03f673a8-4498-4a8d-a768-dfee8a53ad5c" returned: 0 in 0.639s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-03f673a8-4498-4a8d-a768-dfee8a53ad5c" released by "_delete_snapshot" :: held 3.185s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" released by "delete_snapshot" :: held 3.208s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:44 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Created reservations ['3b01d429-954f-490f-b892-134db2c623df', 'e950a7e5-5918-4574-9637-02c6ae1e5066', '0228fc07-afe4-4546-a31f-3565738929c1', '4f828a75-452b-4327-8700-cdb7bda37d4b'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Delete snapshot completed successfully. Jul 08 18:35:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-230824ff-f763-4456-9cb5-04a10d02f84c tempest-ProjectMemberTests-934051372 None] Lock "cinder-03f673a8-4498-4a8d-a768-dfee8a53ad5c-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-edeee7f9-150f-4cf8-8f70-4fb96cb56f42-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Lock "cinder-edeee7f9-150f-4cf8-8f70-4fb96cb56f42-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Acquiring lock "cinder-quobyte-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:35:45 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" acquired by "delete_volume" :: waited 0.017s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:35:45 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcfd07f-8678-4745-a4de-b96cb74b6714]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:35:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:45 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 Jul 08 18:35:45 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:46 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" returned: 0 in 0.795s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:46 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42 Jul 08 18:35:46 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:46 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" returned: 0 in 0.608s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Lock "cinder-quobyte-edeee7f9-150f-4cf8-8f70-4fb96cb56f42" released by "delete_volume" :: held 1.478s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Created reservations ['1db57ef3-1a96-4cce-b2b0-bef08df0398a', '9c23e5b4-d6ef-44b6-bd65-698e2f3bc7cb', '7fb071ae-b97e-4ed7-9d60-82c18a5be233', '7de908e7-f29a-488a-9888-b69256b88fa7'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:35:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:35:46 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:35:46 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:35:47 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 08 18:35:47 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.646s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:35:47 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:35:47 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Deleted volume successfully. Jul 08 18:35:47 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-3bdade1d-c1b3-4c89-9cd0-c98e1d0f992c tempest-ProjectMemberTests-934051372 None] Lock "cinder-edeee7f9-150f-4cf8-8f70-4fb96cb56f42-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:35:56 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:INSERT=18,cinder:SELECT=43,cinder:UPDATE=58,cinder:DELETE=4 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:35:57 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=52,cinder:INSERT=19,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:36:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:36:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:02 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:36:02 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:03 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.640s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:36:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:36:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Flow 'volume_create_manager' (a60d0b9d-147b-4e06-8471-ba76232345c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c38833-5f7a-4298-9d84-49d8fb40cff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c38833-5f7a-4298-9d84-49d8fb40cff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-685039977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a794a8ed-9cd6-4a8b-ab44-98db606396d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf753d31fb14709939a032204ce057b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:25Z,use_quota=True,user_id='03b880cb86f740f98d34e6c5da5c924f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1648dc8-11bf-430a-a016-f561475a4afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1648dc8-11bf-430a-a016-f561475a4afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf546f2-627c-43fb-b449-c8b38f9dc794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf546f2-627c-43fb-b449-c8b38f9dc794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a794a8ed-9cd6-4a8b-ab44-98db606396d7', 'volume_name': 'volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97032ef-0e55-43a6-a63f-6be6aceb387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97032ef-0e55-43a6-a63f-6be6aceb387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4160a60c-d8ad-40a4-8ca6-ea45e1d17d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:24 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Volume a794a8ed-9cd6-4a8b-ab44-98db606396d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7', 'volume_size': 1} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-685039977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a794a8ed-9cd6-4a8b-ab44-98db606396d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf753d31fb14709939a032204ce057b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:25Z,use_quota=True,user_id='03b880cb86f740f98d34e6c5da5c924f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)}" {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Creating volume a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:24 devstack cinder-volume[87309]: INFO cinder.volume.drivers.remotefs [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] casted to osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 Jul 08 18:36:24 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 1073741824 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:24 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 1073741824 Jul 08 18:36:24 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:25 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 1073741824" returned: 0 in 0.797s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:25 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:25 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 Jul 08 18:36:25 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:26 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7" returned: 0 in 0.595s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'} {{(pid=87309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4160a60c-d8ad-40a4-8ca6-ea45e1d17d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7', 'volume_size': 1}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9b0581-6f56-4fa7-a164-2de2b336fc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:26 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Volume volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 (a794a8ed-9cd6-4a8b-ab44-98db606396d7): created successfully Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9b0581-6f56-4fa7-a164-2de2b336fc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Flow 'volume_create_manager' (a60d0b9d-147b-4e06-8471-ba76232345c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:26 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-52d6638b-fddc-4168-aae2-2344c50e0cfc tempest-SnapshotDependencyTests-1384459030 None] Created volume successfully. Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:26 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Creating offline snapshot cef348ca-4387-4a0a-9f4f-d2781221309a of volume a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 18:36:27 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd17c366-24d1-4d9e-9843-6c91b10358f3]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:27 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 Jul 08 18:36:27 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:27 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7" returned: 0 in 0.708s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:27 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a 1G {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:27 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a 1G Jul 08 18:36:27 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:28 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a 1G" returned: 0 in 0.735s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:28 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:28 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a Jul 08 18:36:28 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:29 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 -F qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a" returned: 0 in 0.656s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:29 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a is being set with open permissions: ugo+rw Jul 08 18:36:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:29 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a Jul 08 18:36:29 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:29 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a" returned: 0 in 0.607s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:29 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:29 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.info Jul 08 18:36:29 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:30 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.info" returned: 0 in 0.630s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:30 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.info is being set with open permissions: ugo+rw Jul 08 18:36:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.info {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:30 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.info Jul 08 18:36:30 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:30 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.info" returned: 0 in 0.602s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:30 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.015s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:31 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-5f94ce53-2868-4763-94a1-381b6aac0281 tempest-SnapshotDependencyTests-1384459030 None] Create snapshot completed successfully Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Flow 'volume_create_manager' (1f98ebe9-1397-4891-87cb-8adacaa62218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bec2ab6-e0a7-446d-9c80-57fa1bef677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bec2ab6-e0a7-446d-9c80-57fa1bef677c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T16:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a47e2c0-05fc-4a40-96ad-e2965c8704d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf753d31fb14709939a032204ce057b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T16:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cef348ca-4387-4a0a-9f4f-d2781221309a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T16:36:32Z,use_quota=True,user_id='03b880cb86f740f98d34e6c5da5c924f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e763f3e-7550-4237-ad93-7101a5e9e821),volume_type_id=5e763f3e-7550-4237-ad93-7101a5e9e821)' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502a6bcd-fee9-4ef3-b12c-2051d94f4c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502a6bcd-fee9-4ef3-b12c-2051d94f4c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c37e60c-788a-4a1f-a45b-b1f3f4d48951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c37e60c-788a-4a1f-a45b-b1f3f4d48951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a47e2c0-05fc-4a40-96ad-e2965c8704d3', 'volume_name': 'volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3', 'volume_size': 1, 'snapshot_id': 'cef348ca-4387-4a0a-9f4f-d2781221309a'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fbd2f7-fe6b-49c5-80d1-d3837ec710dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fbd2f7-fe6b-49c5-80d1-d3837ec710dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad11f920-93a6-46ac-8b2b-81761f1a6cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:31 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Volume 3a47e2c0-05fc-4a40-96ad-e2965c8704d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3', 'volume_size': 1, 'snapshot_id': 'cef348ca-4387-4a0a-9f4f-d2781221309a'} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-quobyte-cef348ca-4387-4a0a-9f4f-d2781221309a-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" by "_create_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-cef348ca-4387-4a0a-9f4f-d2781221309a-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Creating volume 3a47e2c0-05fc-4a40-96ad-e2965c8704d3 from snapshot cef348ca-4387-4a0a-9f4f-d2781221309a {{(pid=87309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Selected osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229 as target Quobyte volume. {{(pid=87309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-quobyte-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" by "_copy_volume_from_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] snapshot: cef348ca-4387-4a0a-9f4f-d2781221309a, volume: 3a47e2c0-05fc-4a40-96ad-e2965c8704d3, {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[484b7b3e-0217-4d49-910e-d3e1bea42b1d]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:31 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:31 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a Jul 08 18:36:31 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:32 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a" returned: 0 in 0.706s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:36:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 18:36:32 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Creating direct copy from snapshot {{(pid=87309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 18:36:32 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf409ca-10a1-471f-b754-d04d8ef614f1]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:32 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:32 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 Jul 08 18:36:32 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:33 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7" returned: 0 in 0.726s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:33 devstack cinder-volume[87309]: DEBUG cinder.utils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Path /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 not found in is_blk_device check {{(pid=87309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 18:36:33 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:33 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 Jul 08 18:36:33 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:37 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" returned: 0 in 4.048s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:37 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[490253d7-ea7c-40d7-a24b-e1bc161b8b34]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:37 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:37 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 Jul 08 18:36:37 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:38 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7" returned: 0 in 0.878s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG cinder.image.image_utils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Image conversion details: src /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 {{(pid=87309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 18:36:38 devstack cinder-volume[87309]: INFO cinder.image.image_utils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Converted 1024.00 MB image at 252.90 MB/s Jul 08 18:36:38 devstack cinder-volume[87309]: WARNING cinder.volume.drivers.remotefs [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 is being set with open permissions: ugo+rw Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:38 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 Jul 08 18:36:38 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:38 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" returned: 0 in 0.606s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" released by "_copy_volume_from_snapshot" :: held 7.046s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-cef348ca-4387-4a0a-9f4f-d2781221309a-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" released by "_create_volume_from_snapshot" :: held 7.070s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.083s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad11f920-93a6-46ac-8b2b-81761f1a6cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3', 'volume_size': 1, 'snapshot_id': 'cef348ca-4387-4a0a-9f4f-d2781221309a'}' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ddd34c-a7fa-4b6b-b54b-e75375249b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 18:36:38 devstack cinder-volume[87309]: INFO cinder.volume.flows.manager.create_volume [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Volume volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 (3a47e2c0-05fc-4a40-96ad-e2965c8704d3): created successfully Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ddd34c-a7fa-4b6b-b54b-e75375249b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 18:36:38 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Flow 'volume_create_manager' (1f98ebe9-1397-4891-87cb-8adacaa62218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 18:36:38 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-e5fe71bd-1ecc-40e9-98c7-b84079f6c855 tempest-SnapshotDependencyTests-1384459030 None] Created volume successfully. Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-cef348ca-4387-4a0a-9f4f-d2781221309a-delete_snapshot" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-cef348ca-4387-4a0a-9f4f-d2781221309a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-quobyte-a794a8ed-9cd6-4a8b-ab44-98db606396d7" by "delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-a794a8ed-9cd6-4a8b-ab44-98db606396d7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-quobyte-cef348ca-4387-4a0a-9f4f-d2781221309a" by "_delete_snapshot" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-cef348ca-4387-4a0a-9f4f-d2781221309a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Deleting offline snapshot cef348ca-4387-4a0a-9f4f-d2781221309a of volume a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] snapshot_file for this snap is: volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a {{(pid=87309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[19117981-83a1-455d-8a88-0cdbbce42b04]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:39 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:39 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a Jul 08 18:36:39 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:40 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a" returned: 0 in 0.704s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:40 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.remotefs [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 18:36:40 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aaf821-edb5-464f-a9d4-826ef9df884c]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:40 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 Jul 08 18:36:40 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:40 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7" returned: 0 in 0.706s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:40 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:40 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a Jul 08 18:36:40 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:41 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a" returned: 0 in 0.691s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:41 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:41 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a Jul 08 18:36:41 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:42 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7.cef348ca-4387-4a0a-9f4f-d2781221309a" returned: 0 in 0.594s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-cef348ca-4387-4a0a-9f4f-d2781221309a" released by "_delete_snapshot" :: held 2.782s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-a794a8ed-9cd6-4a8b-ab44-98db606396d7" released by "delete_snapshot" :: held 2.804s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Created reservations ['efc21374-e308-409a-8e2a-8756a404906e', '021c28f3-6275-4c60-a97f-b940b1f77979', 'da9d76a3-898a-45e1-81e2-8e7e7f6bd7a9', '08dde654-314a-49f3-8e42-7b93f57ac859'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:42 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Delete snapshot completed successfully. Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-47eb9a72-a3c8-4e7b-bfdb-fc7262bf5080 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-cef348ca-4387-4a0a-9f4f-d2781221309a-delete_snapshot" released by "delete_snapshot" :: held 2.923s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-a794a8ed-9cd6-4a8b-ab44-98db606396d7-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-a794a8ed-9cd6-4a8b-ab44-98db606396d7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-quobyte-a794a8ed-9cd6-4a8b-ab44-98db606396d7" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-a794a8ed-9cd6-4a8b-ab44-98db606396d7" acquired by "delete_volume" :: waited 0.022s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[122c0ee2-cd04-4836-aa15-41a577d00e57]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:42 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:42 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 Jul 08 18:36:42 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:43 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7" returned: 0 in 0.720s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:43 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7 Jul 08 18:36:43 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:43 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-a794a8ed-9cd6-4a8b-ab44-98db606396d7" returned: 0 in 0.611s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-a794a8ed-9cd6-4a8b-ab44-98db606396d7" released by "delete_volume" :: held 1.387s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Created reservations ['c401dbf5-7bfe-4dba-be87-d0d5f2f5ad3c', 'f957e048-b866-4c1a-857c-1600f1b94d0e', '4acaabb8-5efe-47d6-acc4-3edfc4851c7e', '97ad30fe-75a8-4bc6-be33-445c938634f1'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:43 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:44 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:36:44 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:44 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.640s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:44 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Deleted volume successfully. Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-3a47e2c0-05fc-4a40-96ad-e2965c8704d3-delete_volume" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-7206f40b-04f5-4cc1-8f74-60346a898a65 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-a794a8ed-9cd6-4a8b-ab44-98db606396d7-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-3a47e2c0-05fc-4a40-96ad-e2965c8704d3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "cinder-quobyte-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" by "delete_volume" {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" acquired by "delete_volume" :: waited 0.014s {{(pid=87309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee10d915-504d-4ce2-87f9-77d4d2468157]: (4, 'qcow2') {{(pid=88287) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 18:36:44 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:44 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 Jul 08 18:36:44 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:45 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" returned: 0 in 0.730s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:45 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:45 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3 Jul 08 18:36:45 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:46 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa/volume-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" returned: 0 in 0.638s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-quobyte-3a47e2c0-05fc-4a40-96ad-e2965c8704d3" released by "delete_volume" :: held 1.403s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG cinder.quota [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Created reservations ['5032e7ad-32fb-42bf-acdc-0b1f1b136a72', 'db1108d5-1054-4677-bd03-4c9ef8104bd1', 'c7bf90d1-614b-424e-920f-17d6e297c00e', '47b60f5a-19d8-4918-8a14-8a2969a3d2cf'] {{(pid=87309) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:36:46 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:36:46 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:36:46 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.627s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:36:46 devstack cinder-volume[87309]: INFO cinder.volume.manager [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Deleted volume successfully. Jul 08 18:36:46 devstack cinder-volume[87309]: DEBUG cinder.coordination [None req-94310e86-3771-4558-a4a2-a42280251b05 tempest-SnapshotDependencyTests-1384459030 None] Lock "cinder-3a47e2c0-05fc-4a40-96ad-e2965c8704d3-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=87309) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 18:36:56 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:36:56 devstack cinder-volume[87309]: DEBUG dbcounter [-] [87309] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 18:37:02 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:37:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 18:37:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 18:37:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229': None} {{(pid=87309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 18:37:02 devstack cinder-volume[87309]: DEBUG cinder.volume.drivers.quobyte [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b0e0f57-5089-47ef-842c-709cbb7ab229'] {{(pid=87309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 18:37:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.lockutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 18:37:02 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 18:37:02 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa Jul 08 18:37:02 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 18:37:03 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 08 18:37:03 devstack cinder-volume[87309]: DEBUG oslo_concurrency.processutils [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e69188947c6f6206f06184f1d48c9bfa" returned: 0 in 0.663s {{(pid=87309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 18:37:03 devstack cinder-volume[87309]: DEBUG cinder.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Notifying Schedulers of capabilities ... {{(pid=87309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 18:37:03 devstack cinder-volume[87309]: DEBUG oslo_service.periodic_task [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] Running periodic task VolumeManager._thread_info {{(pid=87309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 18:37:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread count: 28 {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 18:37:03 devstack cinder-volume[87309]: DEBUG cinder.volume.manager [None req-6b24e530-1a0d-4e79-9d74-7ba60c2e80be None None] thread info: [<_MainThread(MainThread, started 131168628658304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}